Max level shown:
12025-02-13T05:15:00.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 08a73a08-3c3e-4bb4-9898-2adc8e661dc2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
22025-02-13T05:15:00.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 08a73a08-3c3e-4bb4-9898-2adc8e661dc2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
32025-02-13T05:15:00.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 08a73a08-3c3e-4bb4-9898-2adc8e661dc2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42025-02-13T05:15:01.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e4bcf5e8-b92b-47fd-98e1-0be2e7af6b7e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
52025-02-13T05:15:01.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e4bcf5e8-b92b-47fd-98e1-0be2e7af6b7e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
62025-02-13T05:15:01.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e4bcf5e8-b92b-47fd-98e1-0be2e7af6b7e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72025-02-13T05:15:02.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0dcb66be-2ec1-467e-b884-22b5dbd46315 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82025-02-13T05:15:02.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0dcb66be-2ec1-467e-b884-22b5dbd46315 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
92025-02-13T05:15:02.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2593 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0dcb66be-2ec1-467e-b884-22b5dbd46315 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
102025-02-13T05:15:03.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7fca4314-e2b4-4c2f-b3dc-f036feaede87 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
112025-02-13T05:15:03.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7fca4314-e2b4-4c2f-b3dc-f036feaede87 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
122025-02-13T05:15:03.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7fca4314-e2b4-4c2f-b3dc-f036feaede87 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
132025-02-13T05:15:04.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c361d88d-038b-4a17-8ad0-16d26395a84b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
142025-02-13T05:15:04.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c361d88d-038b-4a17-8ad0-16d26395a84b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
152025-02-13T05:15:04.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1844 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c361d88d-038b-4a17-8ad0-16d26395a84b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
162025-02-13T05:15:05.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bd4ca441-4a56-4d8a-8184-921ecefa62a6 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
172025-02-13T05:15:05.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bd4ca441-4a56-4d8a-8184-921ecefa62a6 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
182025-02-13T05:15:05.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1901 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bd4ca441-4a56-4d8a-8184-921ecefa62a6 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
192025-02-13T05:15:06.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
202025-02-13T05:15:06.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
212025-02-13T05:15:06.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222025-02-13T05:15:06.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
232025-02-13T05:15:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
242025-02-13T05:15:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
252025-02-13T05:15:06.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
262025-02-13T05:15:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
272025-02-13T05:15:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
282025-02-13T05:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
292025-02-13T05:15:06.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
302025-02-13T05:15:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
312025-02-13T05:15:06.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
322025-02-13T05:15:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
332025-02-13T05:15:06.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
342025-02-13T05:15:06.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
352025-02-13T05:15:06.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
362025-02-13T05:15:06.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
372025-02-13T05:15:06.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
382025-02-13T05:15:06.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.969926ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
392025-02-13T05:15:06.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.599628ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
402025-02-13T05:15:06.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 619ae668-c345-472c-9e0f-e93ef610b415 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
412025-02-13T05:15:06.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 619ae668-c345-472c-9e0f-e93ef610b415 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
422025-02-13T05:15:06.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 619ae668-c345-472c-9e0f-e93ef610b415 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
432025-02-13T05:15:07.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 222efeb3-72c8-4989-b6ad-7b9e0ed28029 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
442025-02-13T05:15:07.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 222efeb3-72c8-4989-b6ad-7b9e0ed28029 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
452025-02-13T05:15:07.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1715 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 222efeb3-72c8-4989-b6ad-7b9e0ed28029 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
462025-02-13T05:15:08.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = eae943e0-373d-4024-b5e4-fe4bfd160505 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
472025-02-13T05:15:08.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = eae943e0-373d-4024-b5e4-fe4bfd160505 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
482025-02-13T05:15:08.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2084 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = eae943e0-373d-4024-b5e4-fe4bfd160505 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
492025-02-13T05:15:09.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3c0a342f-1691-40c8-b3d8-d2c71b7c5f06 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
502025-02-13T05:15:09.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3c0a342f-1691-40c8-b3d8-d2c71b7c5f06 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
512025-02-13T05:15:09.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2046 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3c0a342f-1691-40c8-b3d8-d2c71b7c5f06 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
522025-02-13T05:15:10.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 0dbbef9f-4607-44aa-a13e-988fe535e4e9 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
532025-02-13T05:15:10.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 0dbbef9f-4607-44aa-a13e-988fe535e4e9 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
542025-02-13T05:15:10.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2687 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 0dbbef9f-4607-44aa-a13e-988fe535e4e9 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
552025-02-13T05:15:10.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 80767241-8fae-4377-b405-bf636410f94b roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
562025-02-13T05:15:10.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 80767241-8fae-4377-b405-bf636410f94b resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
572025-02-13T05:15:10.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2164 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 80767241-8fae-4377-b405-bf636410f94b response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
582025-02-13T05:15:10.163ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 363 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 982f7dab-b1e7-4e34-9851-a8cb0cace2f2 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
592025-02-13T05:15:10.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0eb1f237-1d22-41ed-8868-c2e8316b98df roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
602025-02-13T05:15:10.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0eb1f237-1d22-41ed-8868-c2e8316b98df resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
612025-02-13T05:15:10.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0eb1f237-1d22-41ed-8868-c2e8316b98df response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
622025-02-13T05:15:11.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89319ddf-4fe1-4695-95cb-c67fc1f2eeef roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
632025-02-13T05:15:11.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89319ddf-4fe1-4695-95cb-c67fc1f2eeef resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
642025-02-13T05:15:11.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89319ddf-4fe1-4695-95cb-c67fc1f2eeef response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
652025-02-13T05:15:12.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1c76b2ba-7c1b-459b-94e3-f3bcffd027c2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
662025-02-13T05:15:12.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1c76b2ba-7c1b-459b-94e3-f3bcffd027c2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
672025-02-13T05:15:12.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2084 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1c76b2ba-7c1b-459b-94e3-f3bcffd027c2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
682025-02-13T05:15:13.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 46504db2-c044-4f18-9261-30d1f0f49058 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
692025-02-13T05:15:13.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 46504db2-c044-4f18-9261-30d1f0f49058 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
702025-02-13T05:15:13.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 46504db2-c044-4f18-9261-30d1f0f49058 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
712025-02-13T05:15:14.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6c9de08a-f182-47d7-8989-1ec0da3a200b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
722025-02-13T05:15:14.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6c9de08a-f182-47d7-8989-1ec0da3a200b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
732025-02-13T05:15:14.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2211 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6c9de08a-f182-47d7-8989-1ec0da3a200b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
742025-02-13T05:15:15.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f8eadb70-9a0d-488c-b04e-563ecbbe0769 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
752025-02-13T05:15:15.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f8eadb70-9a0d-488c-b04e-563ecbbe0769 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
762025-02-13T05:15:15.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1999 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f8eadb70-9a0d-488c-b04e-563ecbbe0769 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
772025-02-13T05:15:16.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
782025-02-13T05:15:16.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
792025-02-13T05:15:16.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
802025-02-13T05:15:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
812025-02-13T05:15:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
822025-02-13T05:15:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
832025-02-13T05:15:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
842025-02-13T05:15:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
852025-02-13T05:15:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
862025-02-13T05:15:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
872025-02-13T05:15:16.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
882025-02-13T05:15:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
892025-02-13T05:15:16.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
902025-02-13T05:15:16.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
912025-02-13T05:15:16.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
922025-02-13T05:15:16.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
932025-02-13T05:15:16.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
942025-02-13T05:15:16.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.464479ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
952025-02-13T05:15:16.279ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
962025-02-13T05:15:16.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
972025-02-13T05:15:16.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.3787ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
982025-02-13T05:15:16.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e740f1b1-a2ae-4b2d-9208-80dbb2412c73 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
992025-02-13T05:15:16.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e740f1b1-a2ae-4b2d-9208-80dbb2412c73 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1002025-02-13T05:15:16.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1732 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e740f1b1-a2ae-4b2d-9208-80dbb2412c73 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1012025-02-13T05:15:17.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8df98bff-2208-4bbc-88b8-9fdec2d4e88d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1022025-02-13T05:15:17.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8df98bff-2208-4bbc-88b8-9fdec2d4e88d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1032025-02-13T05:15:17.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8df98bff-2208-4bbc-88b8-9fdec2d4e88d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1042025-02-13T05:15:18.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = af102854-a0ff-40e7-8437-f488cf99d4d7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1052025-02-13T05:15:18.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = af102854-a0ff-40e7-8437-f488cf99d4d7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1062025-02-13T05:15:18.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = af102854-a0ff-40e7-8437-f488cf99d4d7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1072025-02-13T05:15:19.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 34d950dc-f411-4646-9847-a0cf0e8f35ff roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1082025-02-13T05:15:19.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 34d950dc-f411-4646-9847-a0cf0e8f35ff resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1092025-02-13T05:15:19.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 34d950dc-f411-4646-9847-a0cf0e8f35ff response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1102025-02-13T05:15:20.163ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 368 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 373d09dd-9a2d-4fce-b492-3b1cbfc2f356 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
1112025-02-13T05:15:20.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 908932aa-7956-4b2d-bd80-ecd3991b4c73 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1122025-02-13T05:15:20.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 908932aa-7956-4b2d-bd80-ecd3991b4c73 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1132025-02-13T05:15:20.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1853 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 908932aa-7956-4b2d-bd80-ecd3991b4c73 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1142025-02-13T05:15:21.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7ac865a7-034f-4854-80e5-77ce41986125 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1152025-02-13T05:15:21.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7ac865a7-034f-4854-80e5-77ce41986125 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1162025-02-13T05:15:21.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1854 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7ac865a7-034f-4854-80e5-77ce41986125 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1172025-02-13T05:15:23.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 77a1dadb-66f4-44dd-a8e9-87ae7af4aba3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1182025-02-13T05:15:23.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 77a1dadb-66f4-44dd-a8e9-87ae7af4aba3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1192025-02-13T05:15:23.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 77a1dadb-66f4-44dd-a8e9-87ae7af4aba3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1202025-02-13T05:15:24.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c242bb9d-f86c-4ae0-83b4-c14701eb101d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1212025-02-13T05:15:24.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c242bb9d-f86c-4ae0-83b4-c14701eb101d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1222025-02-13T05:15:24.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c242bb9d-f86c-4ae0-83b4-c14701eb101d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1232025-02-13T05:15:25.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 066805d0-de4e-4839-a18a-090b844d8a27 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1242025-02-13T05:15:25.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 066805d0-de4e-4839-a18a-090b844d8a27 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1252025-02-13T05:15:25.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2000 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 066805d0-de4e-4839-a18a-090b844d8a27 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1262025-02-13T05:15:26.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5d928049-7070-4b66-b999-421cbb73ba22 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1272025-02-13T05:15:26.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5d928049-7070-4b66-b999-421cbb73ba22 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1282025-02-13T05:15:26.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5d928049-7070-4b66-b999-421cbb73ba22 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
1292025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
1302025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
1312025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
1322025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1332025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1342025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
1352025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1362025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
1372025-02-13T05:15:26.241ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1382025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
1392025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1402025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1412025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
1422025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
1432025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1442025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1452025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
1462025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1472025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
1482025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1492025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
1502025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
1512025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1522025-02-13T05:15:26.241ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-13 05:05:26.241804691 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1532025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1542025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
1552025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
1562025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1572025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
1582025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1592025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
1602025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1612025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
1622025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1632025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
1642025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1652025-02-13T05:15:26.241ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1662025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1672025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
1682025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1692025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
1702025-02-13T05:15:26.242ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = e132683f-3ab0-4513-890f-86716ec9a9cf
1712025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.801\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf"}
1722025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
1732025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1742025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
1752025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
1762025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1772025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
1782025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1792025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
1802025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1812025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
1822025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
1832025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1842025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
1852025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
1862025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
1872025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1882025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1892025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
1902025-02-13T05:15:26.242ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1912025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1922025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1932025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
1942025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
1952025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1962025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1972025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1982025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1992025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
2002025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
2012025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2022025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2032025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2042025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
2052025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2062025-02-13T05:15:26.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec95727a-7af6-45d1-9962-81bf544db84b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 780419772 } })
2072025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2082025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2092025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2102025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2112025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2122025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2132025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2142025-02-13T05:15:26.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9f4eb8b3-c464-433c-b912-c7432c124258.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cc24f910-ffb5-4de8-b7e1-4b9d4d15a7cd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 780499885 } })
2152025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2162025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2172025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2182025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2192025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
2202025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2212025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2222025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2232025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
2242025-02-13T05:15:26.242ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 945.837\u{b5}s iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
2252025-02-13T05:15:26.243ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
2262025-02-13T05:15:26.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.072931ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
2272025-02-13T05:15:26.245ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.082416ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
2282025-02-13T05:15:26.246ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.969703ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2292025-02-13T05:15:26.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 784978812 } })
2302025-02-13T05:15:26.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2312025-02-13T05:15:26.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
2322025-02-13T05:15:26.248ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-13 05:05:26.241804691 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2332025-02-13T05:15:26.248ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.274178ms iteration = 8 status = {"expiration":"2025-02-13T05:05:26.241804691Z","pruned":[]}
2342025-02-13T05:15:26.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 786184416 } })
2352025-02-13T05:15:26.248ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
2362025-02-13T05:15:26.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2372025-02-13T05:15:26.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2382025-02-13T05:15:26.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2392025-02-13T05:15:26.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2402025-02-13T05:15:26.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2412025-02-13T05:15:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2422025-02-13T05:15:26.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2432025-02-13T05:15:26.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2442025-02-13T05:15:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2452025-02-13T05:15:26.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2462025-02-13T05:15:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2472025-02-13T05:15:26.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2482025-02-13T05:15:26.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2492025-02-13T05:15:26.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2502025-02-13T05:15:26.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2512025-02-13T05:15:26.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2522025-02-13T05:15:26.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2532025-02-13T05:15:26.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2542025-02-13T05:15:26.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2552025-02-13T05:15:26.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2562025-02-13T05:15:26.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2572025-02-13T05:15:26.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2582025-02-13T05:15:26.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2592025-02-13T05:15:26.309ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 67.948412ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
2602025-02-13T05:15:26.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2612025-02-13T05:15:26.314ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2622025-02-13T05:15:26.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2632025-02-13T05:15:26.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2642025-02-13T05:15:26.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2652025-02-13T05:15:26.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2662025-02-13T05:15:26.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2672025-02-13T05:15:26.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2682025-02-13T05:15:26.319ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2692025-02-13T05:15:26.319ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2702025-02-13T05:15:26.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2712025-02-13T05:15:26.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2722025-02-13T05:15:26.324ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2732025-02-13T05:15:26.326ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2742025-02-13T05:15:26.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2752025-02-13T05:15:26.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2762025-02-13T05:15:26.328ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2772025-02-13T05:15:26.328ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2782025-02-13T05:15:26.328ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.673195ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
2792025-02-13T05:15:26.328ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2802025-02-13T05:15:26.328ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 86.843101ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
2812025-02-13T05:15:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2822025-02-13T05:15:26.329ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2832025-02-13T05:15:26.329ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2842025-02-13T05:15:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2852025-02-13T05:15:26.330ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2862025-02-13T05:15:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2872025-02-13T05:15:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2882025-02-13T05:15:26.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2892025-02-13T05:15:26.331ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2902025-02-13T05:15:26.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2912025-02-13T05:15:26.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2922025-02-13T05:15:26.332ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2932025-02-13T05:15:26.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2942025-02-13T05:15:26.332ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2952025-02-13T05:15:26.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2962025-02-13T05:15:26.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2972025-02-13T05:15:26.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2982025-02-13T05:15:26.333ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2992025-02-13T05:15:26.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3002025-02-13T05:15:26.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3012025-02-13T05:15:26.335ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3022025-02-13T05:15:26.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3032025-02-13T05:15:26.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
3042025-02-13T05:15:26.338ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3052025-02-13T05:15:26.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3062025-02-13T05:15:26.345ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.374171ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3072025-02-13T05:15:26.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3082025-02-13T05:15:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3092025-02-13T05:15:26.351ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
3102025-02-13T05:15:26.351ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
3112025-02-13T05:15:26.351ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 109.446823ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
3122025-02-13T05:15:26.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3132025-02-13T05:15:26.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3142025-02-13T05:15:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3152025-02-13T05:15:26.356ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 894011054 } })
3162025-02-13T05:15:26.356ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
3172025-02-13T05:15:26.356ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3182025-02-13T05:15:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
3192025-02-13T05:15:26.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3202025-02-13T05:15:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3212025-02-13T05:15:26.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3222025-02-13T05:15:26.361ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3232025-02-13T05:15:26.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3242025-02-13T05:15:26.364ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3252025-02-13T05:15:26.364ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3262025-02-13T05:15:26.364ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3272025-02-13T05:15:26.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3282025-02-13T05:15:26.364ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3292025-02-13T05:15:26.364ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3302025-02-13T05:15:26.364ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3312025-02-13T05:15:26.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3322025-02-13T05:15:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3332025-02-13T05:15:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3342025-02-13T05:15:26.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3352025-02-13T05:15:26.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3362025-02-13T05:15:26.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3372025-02-13T05:15:26.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3382025-02-13T05:15:26.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3392025-02-13T05:15:26.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3402025-02-13T05:15:26.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3412025-02-13T05:15:26.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3422025-02-13T05:15:26.372ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3432025-02-13T05:15:26.372ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 130.989456ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3442025-02-13T05:15:26.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 133.340943ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3452025-02-13T05:15:26.385ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3462025-02-13T05:15:26.385ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3472025-02-13T05:15:26.385ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3482025-02-13T05:15:26.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3492025-02-13T05:15:26.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3502025-02-13T05:15:26.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3512025-02-13T05:15:26.387ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3522025-02-13T05:15:26.387ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 0 version = 2
3532025-02-13T05:15:26.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3542025-02-13T05:15:26.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3552025-02-13T05:15:26.387ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
3562025-02-13T05:15:26.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3572025-02-13T05:15:26.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3582025-02-13T05:15:26.405ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3592025-02-13T05:15:26.406ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3602025-02-13T05:15:26.407ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3612025-02-13T05:15:26.407ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3622025-02-13T05:15:26.407ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3632025-02-13T05:15:26.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3642025-02-13T05:15:26.407ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
3652025-02-13T05:15:26.407ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 166.013683ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
3662025-02-13T05:15:26.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3672025-02-13T05:15:26.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3682025-02-13T05:15:26.409ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3692025-02-13T05:15:26.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3702025-02-13T05:15:26.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3712025-02-13T05:15:26.410ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3722025-02-13T05:15:26.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3732025-02-13T05:15:26.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3742025-02-13T05:15:26.411ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3752025-02-13T05:15:26.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3762025-02-13T05:15:26.414ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3772025-02-13T05:15:26.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 172.480056ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
3782025-02-13T05:15:26.417ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 1 version = 2
3792025-02-13T05:15:26.417ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3802025-02-13T05:15:26.417ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-13 05:08:27.963644 UTC dns_group = external generation = 2
3812025-02-13T05:15:26.417ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 175.911444ms iteration = 8 status = {"generation":2}
3822025-02-13T05:15:26.418ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3832025-02-13T05:15:26.418ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3842025-02-13T05:15:26.418ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-13 05:08:26.528706 UTC dns_group = internal generation = 1
3852025-02-13T05:15:26.419ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 177.114138ms iteration = 8 status = {"generation":1}
3862025-02-13T05:15:26.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
3872025-02-13T05:15:26.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3882025-02-13T05:15:26.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3892025-02-13T05:15:26.422ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 180.684589ms iteration = 15 status = 0
3902025-02-13T05:15:26.423ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3912025-02-13T05:15:26.423ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3922025-02-13T05:15:26.423ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 181.265066ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3932025-02-13T05:15:26.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 184.92466ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3942025-02-13T05:15:26.430ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3952025-02-13T05:15:26.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3962025-02-13T05:15:26.432ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3972025-02-13T05:15:26.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
3982025-02-13T05:15:26.437ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3992025-02-13T05:15:26.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
4002025-02-13T05:15:26.450ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
4012025-02-13T05:15:26.450ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4022025-02-13T05:15:26.452ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44aa2d35-d52c-4761-b9db-8926b9c80533", "content-length": "26", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
4032025-02-13T05:15:26.452ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4042025-02-13T05:15:26.458ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4052025-02-13T05:15:26.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4062025-02-13T05:15:26.460ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4072025-02-13T05:15:26.464ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
4082025-02-13T05:15:26.464ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4092025-02-13T05:15:26.464ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80a0b0ec-1517-4c79-aae7-cad87d0bf1c6", "content-length": "26", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
4102025-02-13T05:15:26.465ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4112025-02-13T05:15:26.468ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4122025-02-13T05:15:26.470ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4132025-02-13T05:15:26.472ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4142025-02-13T05:15:26.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4152025-02-13T05:15:26.476ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4162025-02-13T05:15:26.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4172025-02-13T05:15:26.481ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4182025-02-13T05:15:26.481ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
4192025-02-13T05:15:26.481ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 239.533374ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
4202025-02-13T05:15:26.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4212025-02-13T05:15:26.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4222025-02-13T05:15:26.510ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
4232025-02-13T05:15:26.510ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4242025-02-13T05:15:26.512ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7215212e-4ee9-43b9-8e72-371a971405fc", "content-length": "26", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
4252025-02-13T05:15:26.512ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4262025-02-13T05:15:26.514ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
4272025-02-13T05:15:26.530ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
4282025-02-13T05:15:26.530ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 288.63002ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
4292025-02-13T05:15:26.536ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 294.638511ms iteration = 16 status = {"physical_disks_added":0}
4302025-02-13T05:15:26.545ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-13T05:08:23.439194Z, time_modified: 2025-02-13T05:08:23.439194Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }) }
4312025-02-13T05:15:26.545ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 303.196335ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]}},"default_endpoint":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4322025-02-13T05:15:26.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4332025-02-13T05:15:26.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4342025-02-13T05:15:26.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4352025-02-13T05:15:26.587ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4362025-02-13T05:15:26.587ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4372025-02-13T05:15:26.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4382025-02-13T05:15:26.589ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4392025-02-13T05:15:26.591ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4402025-02-13T05:15:26.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4412025-02-13T05:15:26.591ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4422025-02-13T05:15:26.591ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 349.472881ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4432025-02-13T05:15:26.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4442025-02-13T05:15:26.682ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4452025-02-13T05:15:26.682ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4462025-02-13T05:15:26.683ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "079b1a82-bf6a-46ac-a456-7725561e9839", "content-length": "372", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
4472025-02-13T05:15:26.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4482025-02-13T05:15:26.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4492025-02-13T05:15:26.690ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4502025-02-13T05:15:26.690ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2d6aef68-2be0-4794-8f80-d795134bb208", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4512025-02-13T05:15:26.690ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4522025-02-13T05:15:26.692ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ac0c1685-b617-4a15-b3bf-c7790661bc49", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4532025-02-13T05:15:26.692ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4542025-02-13T05:15:26.695ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4552025-02-13T05:15:26.695ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 453.260083ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4562025-02-13T05:15:26.704ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4572025-02-13T05:15:26.705ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
4582025-02-13T05:15:26.705ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4592025-02-13T05:15:26.705ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4076e8ae-d710-4855-b782-6b49e8870d54", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
4602025-02-13T05:15:26.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4612025-02-13T05:15:26.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4622025-02-13T05:15:26.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4632025-02-13T05:15:26.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4642025-02-13T05:15:26.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4652025-02-13T05:15:26.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4662025-02-13T05:15:26.717ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4672025-02-13T05:15:26.717ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4682025-02-13T05:15:26.717ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a195ebac-76fd-4b52-a703-8f7185f3bf4d", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
4692025-02-13T05:15:26.719ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 477.838942ms iteration = 15 status = {}
4702025-02-13T05:15:26.838ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4712025-02-13T05:15:26.838ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "44ed8279-96d8-46da-a9c6-cf7c65a20631", "content-length": "1", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
4722025-02-13T05:15:26.841ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4732025-02-13T05:15:26.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4742025-02-13T05:15:26.845ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4752025-02-13T05:15:26.846ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "804b9f1f-d131-4833-af13-29d457a7f8e9", "content-length": "691", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
4762025-02-13T05:15:26.846ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
4772025-02-13T05:15:26.846ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4782025-02-13T05:15:26.846ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
4792025-02-13T05:15:26.847ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 606.047539ms iteration = 15 status = {}
4802025-02-13T05:15:26.848ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 606.496201ms iteration = 15 status = null
4812025-02-13T05:15:26.861ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 619.607315ms iteration = 15 status = {}
4822025-02-13T05:15:26.896ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4832025-02-13T05:15:26.896ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9b0480c0-a6cf-4f5b-8776-983775bfb078", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4842025-02-13T05:15:26.896ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4852025-02-13T05:15:26.898ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d9b7cfa7-4c61-492d-adc5-b72f4be878f2", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4862025-02-13T05:15:26.898ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4872025-02-13T05:15:26.900ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ec7bbdf0-bc2d-4974-9875-8bfdf4b9c5c6", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4882025-02-13T05:15:26.900ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4892025-02-13T05:15:26.902ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4902025-02-13T05:15:26.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 660.826697ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4912025-02-13T05:15:26.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4922025-02-13T05:15:26.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4932025-02-13T05:15:26.917ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
4942025-02-13T05:15:26.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4952025-02-13T05:15:26.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4962025-02-13T05:15:26.927ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4972025-02-13T05:15:26.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b347b31a-1224-4ca2-b1a1-f51acededbbf", "content-length": "134", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
4982025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4992025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
5002025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5012025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5022025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5032025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5042025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5052025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5062025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5072025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5082025-02-13T05:15:26.928ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
5092025-02-13T05:15:26.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5102025-02-13T05:15:26.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5112025-02-13T05:15:26.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5122025-02-13T05:15:26.931ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "845c1660-09d4-430d-9ed4-99d91e32aec5", "content-length": "2", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
5132025-02-13T05:15:26.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5142025-02-13T05:15:26.931ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "da700de8-adf4-4cee-a7a9-20c1ccfd54d2", "content-length": "52", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
5152025-02-13T05:15:26.931ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
5162025-02-13T05:15:26.931ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5172025-02-13T05:15:27.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9dfb10d6-ac81-4081-9179-d9290547ceb5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5182025-02-13T05:15:27.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9dfb10d6-ac81-4081-9179-d9290547ceb5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5192025-02-13T05:15:27.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9dfb10d6-ac81-4081-9179-d9290547ceb5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5202025-02-13T05:15:27.154ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6c3b9742-7540-46c1-ada0-7435aea524cc", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
5212025-02-13T05:15:27.154ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
5222025-02-13T05:15:27.154ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5232025-02-13T05:15:27.154ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5dfff2d-15b3-4826-8ad8-ff1edd4e6f28", "content-length": "682", "date": "Thu, 13 Feb 2025 05:15:26 GMT"} })
5242025-02-13T05:15:27.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5252025-02-13T05:15:27.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5262025-02-13T05:15:27.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5272025-02-13T05:15:27.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5282025-02-13T05:15:27.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5292025-02-13T05:15:27.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5302025-02-13T05:15:27.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5312025-02-13T05:15:27.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5322025-02-13T05:15:27.170ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 928.81205ms iteration = 15 status = {}
5332025-02-13T05:15:28.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2ebe26f6-3212-47d2-b272-01b71019cbcd roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5342025-02-13T05:15:28.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2ebe26f6-3212-47d2-b272-01b71019cbcd resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5352025-02-13T05:15:28.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2ebe26f6-3212-47d2-b272-01b71019cbcd response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5362025-02-13T05:15:29.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2dd41d0e-45de-493b-9514-2f4481e0a23d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5372025-02-13T05:15:29.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2dd41d0e-45de-493b-9514-2f4481e0a23d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5382025-02-13T05:15:29.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2dd41d0e-45de-493b-9514-2f4481e0a23d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5392025-02-13T05:15:30.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3f11e29a-c192-4063-9d99-3948aa8d82af roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5402025-02-13T05:15:30.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3f11e29a-c192-4063-9d99-3948aa8d82af resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5412025-02-13T05:15:30.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3f11e29a-c192-4063-9d99-3948aa8d82af response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5422025-02-13T05:15:30.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 374 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = a3851fc3-f8a6-446e-87f9-1753fbd42b70 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
5432025-02-13T05:15:31.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96a38155-30dc-4172-b58a-9108b5f3d2de roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5442025-02-13T05:15:31.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96a38155-30dc-4172-b58a-9108b5f3d2de resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5452025-02-13T05:15:31.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96a38155-30dc-4172-b58a-9108b5f3d2de response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5462025-02-13T05:15:32.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bb89d930-101e-4789-88e1-6818ea279789 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5472025-02-13T05:15:32.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bb89d930-101e-4789-88e1-6818ea279789 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5482025-02-13T05:15:32.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1760 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bb89d930-101e-4789-88e1-6818ea279789 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5492025-02-13T05:15:33.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 50cdee7d-3c57-4d2a-a858-673513302158 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5502025-02-13T05:15:33.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 50cdee7d-3c57-4d2a-a858-673513302158 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5512025-02-13T05:15:33.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 50cdee7d-3c57-4d2a-a858-673513302158 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5522025-02-13T05:15:34.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3a609e5c-318d-427a-9d52-0d051d869835 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5532025-02-13T05:15:34.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3a609e5c-318d-427a-9d52-0d051d869835 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5542025-02-13T05:15:34.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3a609e5c-318d-427a-9d52-0d051d869835 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5552025-02-13T05:15:35.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = baa23188-1423-4951-9fdb-458869fce1d3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5562025-02-13T05:15:35.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = baa23188-1423-4951-9fdb-458869fce1d3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5572025-02-13T05:15:35.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2344 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = baa23188-1423-4951-9fdb-458869fce1d3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5582025-02-13T05:15:36.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
5592025-02-13T05:15:36.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
5602025-02-13T05:15:36.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5612025-02-13T05:15:36.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5622025-02-13T05:15:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5632025-02-13T05:15:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5642025-02-13T05:15:36.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5652025-02-13T05:15:36.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5662025-02-13T05:15:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5672025-02-13T05:15:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5682025-02-13T05:15:36.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5692025-02-13T05:15:36.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.580769ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5702025-02-13T05:15:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5712025-02-13T05:15:36.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5722025-02-13T05:15:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5732025-02-13T05:15:36.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5742025-02-13T05:15:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
5752025-02-13T05:15:36.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5762025-02-13T05:15:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5772025-02-13T05:15:36.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
5782025-02-13T05:15:36.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.421686ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
5792025-02-13T05:15:36.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8fb98707-ffd2-481f-870e-4bac7ab738e0 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5802025-02-13T05:15:36.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8fb98707-ffd2-481f-870e-4bac7ab738e0 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5812025-02-13T05:15:36.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1902 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8fb98707-ffd2-481f-870e-4bac7ab738e0 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5822025-02-13T05:15:37.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 16a665af-9273-46e7-8afc-6d06fa5783ff roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5832025-02-13T05:15:37.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 16a665af-9273-46e7-8afc-6d06fa5783ff resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5842025-02-13T05:15:37.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 16a665af-9273-46e7-8afc-6d06fa5783ff response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5852025-02-13T05:15:38.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21cb1649-bc78-4d4c-b20b-f23d3163b6aa roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5862025-02-13T05:15:38.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21cb1649-bc78-4d4c-b20b-f23d3163b6aa resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5872025-02-13T05:15:38.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21cb1649-bc78-4d4c-b20b-f23d3163b6aa response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5882025-02-13T05:15:39.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f111b9bd-2329-4817-95ac-f93f83a23df9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5892025-02-13T05:15:39.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f111b9bd-2329-4817-95ac-f93f83a23df9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5902025-02-13T05:15:39.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f111b9bd-2329-4817-95ac-f93f83a23df9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5912025-02-13T05:15:40.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = be4a708b-5807-4fbc-9949-3a911905571b roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
5922025-02-13T05:15:40.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = be4a708b-5807-4fbc-9949-3a911905571b resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
5932025-02-13T05:15:40.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3242 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = be4a708b-5807-4fbc-9949-3a911905571b response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
5942025-02-13T05:15:40.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 030bde60-24cf-40c1-8ce6-73a6cbf4cb6d roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
5952025-02-13T05:15:40.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 030bde60-24cf-40c1-8ce6-73a6cbf4cb6d resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
5962025-02-13T05:15:40.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1930 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 030bde60-24cf-40c1-8ce6-73a6cbf4cb6d response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
5972025-02-13T05:15:40.164ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 604 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 24403849-d49a-4aa3-941b-aa1d832df00a response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
5982025-02-13T05:15:40.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 22988cc7-5de2-4ab0-8ba0-7b9aa2fb4add roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
5992025-02-13T05:15:40.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 22988cc7-5de2-4ab0-8ba0-7b9aa2fb4add resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6002025-02-13T05:15:40.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2079 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 22988cc7-5de2-4ab0-8ba0-7b9aa2fb4add response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6012025-02-13T05:15:41.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8d51878f-866c-4be1-a495-3bb7d868f462 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6022025-02-13T05:15:41.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8d51878f-866c-4be1-a495-3bb7d868f462 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6032025-02-13T05:15:41.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8d51878f-866c-4be1-a495-3bb7d868f462 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6042025-02-13T05:15:42.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 788bb8fc-a392-48fe-a0fa-d3832ecb9ab7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6052025-02-13T05:15:42.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 788bb8fc-a392-48fe-a0fa-d3832ecb9ab7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6062025-02-13T05:15:42.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 788bb8fc-a392-48fe-a0fa-d3832ecb9ab7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6072025-02-13T05:15:43.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e26d3f34-d856-4813-8a82-e7abda3d32d1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6082025-02-13T05:15:43.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e26d3f34-d856-4813-8a82-e7abda3d32d1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6092025-02-13T05:15:43.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e26d3f34-d856-4813-8a82-e7abda3d32d1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6102025-02-13T05:15:44.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6f84a804-43c9-4b82-9c99-3a8ee36cf87d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6112025-02-13T05:15:44.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6f84a804-43c9-4b82-9c99-3a8ee36cf87d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6122025-02-13T05:15:44.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1934 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6f84a804-43c9-4b82-9c99-3a8ee36cf87d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6132025-02-13T05:15:45.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7bbbca58-3601-4156-b398-c9f6d00c5a56 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6142025-02-13T05:15:45.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7bbbca58-3601-4156-b398-c9f6d00c5a56 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6152025-02-13T05:15:45.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7bbbca58-3601-4156-b398-c9f6d00c5a56 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6162025-02-13T05:15:46.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
6172025-02-13T05:15:46.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
6182025-02-13T05:15:46.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6192025-02-13T05:15:46.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6202025-02-13T05:15:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6212025-02-13T05:15:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6222025-02-13T05:15:46.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6232025-02-13T05:15:46.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6242025-02-13T05:15:46.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6252025-02-13T05:15:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6262025-02-13T05:15:46.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6272025-02-13T05:15:46.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.725805ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6282025-02-13T05:15:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6292025-02-13T05:15:46.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6302025-02-13T05:15:46.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6312025-02-13T05:15:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6322025-02-13T05:15:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
6332025-02-13T05:15:46.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6342025-02-13T05:15:46.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6352025-02-13T05:15:46.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
6362025-02-13T05:15:46.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.117229ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
6372025-02-13T05:15:46.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6c86464a-42c2-4262-b841-3740df328097 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6382025-02-13T05:15:46.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6c86464a-42c2-4262-b841-3740df328097 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6392025-02-13T05:15:46.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6c86464a-42c2-4262-b841-3740df328097 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6402025-02-13T05:15:47.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d699ef4e-9ae8-4909-967e-c4cb7c3829c2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6412025-02-13T05:15:47.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d699ef4e-9ae8-4909-967e-c4cb7c3829c2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6422025-02-13T05:15:47.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d699ef4e-9ae8-4909-967e-c4cb7c3829c2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6432025-02-13T05:15:48.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7f3c813b-05a3-4c3b-a8ef-a8127beae073 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6442025-02-13T05:15:48.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7f3c813b-05a3-4c3b-a8ef-a8127beae073 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6452025-02-13T05:15:48.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1824 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7f3c813b-05a3-4c3b-a8ef-a8127beae073 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6462025-02-13T05:15:49.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8c97a020-87c5-419b-9cd3-de02ff81bee7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6472025-02-13T05:15:49.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8c97a020-87c5-419b-9cd3-de02ff81bee7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6482025-02-13T05:15:49.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8c97a020-87c5-419b-9cd3-de02ff81bee7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6492025-02-13T05:15:50.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 373 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = af25d3fd-994a-42d6-8714-3934b7d8e2cd response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
6502025-02-13T05:15:50.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a8d9fbd4-b560-43ac-9553-fba3acbae21d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6512025-02-13T05:15:50.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a8d9fbd4-b560-43ac-9553-fba3acbae21d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6522025-02-13T05:15:50.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a8d9fbd4-b560-43ac-9553-fba3acbae21d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6532025-02-13T05:15:51.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9b2c7f31-9e93-48ca-8652-4bea47e32c12 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6542025-02-13T05:15:51.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9b2c7f31-9e93-48ca-8652-4bea47e32c12 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6552025-02-13T05:15:51.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9b2c7f31-9e93-48ca-8652-4bea47e32c12 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6562025-02-13T05:15:52.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0c7e05e2-543b-462b-a6ef-f075a04a292b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6572025-02-13T05:15:52.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0c7e05e2-543b-462b-a6ef-f075a04a292b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6582025-02-13T05:15:52.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0c7e05e2-543b-462b-a6ef-f075a04a292b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6592025-02-13T05:15:53.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3c20efda-5b6f-4c8e-a9ae-14505b1d6dad roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6602025-02-13T05:15:53.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3c20efda-5b6f-4c8e-a9ae-14505b1d6dad resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6612025-02-13T05:15:53.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2584 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3c20efda-5b6f-4c8e-a9ae-14505b1d6dad response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6622025-02-13T05:15:54.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 232c64ee-3d2c-4aa3-94f1-823d383dd0d3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6632025-02-13T05:15:54.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 232c64ee-3d2c-4aa3-94f1-823d383dd0d3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6642025-02-13T05:15:54.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2548 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 232c64ee-3d2c-4aa3-94f1-823d383dd0d3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6652025-02-13T05:15:55.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f695a2cb-914e-4bfa-951f-24b8b7886c01 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6662025-02-13T05:15:55.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f695a2cb-914e-4bfa-951f-24b8b7886c01 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6672025-02-13T05:15:55.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f695a2cb-914e-4bfa-951f-24b8b7886c01 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
6682025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
6692025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
6702025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6712025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6722025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6732025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
6742025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
6752025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6762025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
6772025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
6782025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6792025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
6802025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6812025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
6822025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6832025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
6842025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6852025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
6862025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6872025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
6882025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6892025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
6902025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6912025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
6922025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6932025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
6942025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6952025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
6962025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6972025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
6982025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
6992025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7002025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
7012025-02-13T05:15:56.241ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
7022025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
7032025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
7042025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7052025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7062025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7072025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7082025-02-13T05:15:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7092025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7102025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
7112025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7122025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7132025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7142025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7152025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7162025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7172025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7182025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7192025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7202025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7212025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7222025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7232025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7242025-02-13T05:15:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7252025-02-13T05:15:56.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7262025-02-13T05:15:56.244ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7272025-02-13T05:15:56.244ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7282025-02-13T05:15:56.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7292025-02-13T05:15:56.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7302025-02-13T05:15:56.245ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.492349ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7312025-02-13T05:15:56.245ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7322025-02-13T05:15:56.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7332025-02-13T05:15:56.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7342025-02-13T05:15:56.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7352025-02-13T05:15:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7362025-02-13T05:15:56.247ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7372025-02-13T05:15:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7382025-02-13T05:15:56.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7392025-02-13T05:15:56.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7402025-02-13T05:15:56.248ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 6.847185ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
7412025-02-13T05:15:56.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7422025-02-13T05:15:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7432025-02-13T05:15:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7442025-02-13T05:15:56.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7452025-02-13T05:15:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7462025-02-13T05:15:56.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7472025-02-13T05:15:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7482025-02-13T05:15:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7492025-02-13T05:15:56.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7502025-02-13T05:15:56.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7512025-02-13T05:15:56.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7522025-02-13T05:15:56.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7532025-02-13T05:15:56.256ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7542025-02-13T05:15:56.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.166702ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
7552025-02-13T05:15:56.258ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 797138398 } })
7562025-02-13T05:15:56.259ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 797307783 } })
7572025-02-13T05:15:56.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7582025-02-13T05:15:56.259ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
7592025-02-13T05:15:56.259ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7602025-02-13T05:15:56.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7612025-02-13T05:15:56.259ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
7622025-02-13T05:15:56.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7632025-02-13T05:15:56.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7642025-02-13T05:15:56.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7652025-02-13T05:15:56.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7662025-02-13T05:15:56.269ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7672025-02-13T05:15:56.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7682025-02-13T05:15:56.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7692025-02-13T05:15:56.271ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 810009494 } })
7702025-02-13T05:15:56.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7712025-02-13T05:15:56.272ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
7722025-02-13T05:15:56.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7732025-02-13T05:15:56.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7742025-02-13T05:15:56.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7752025-02-13T05:15:56.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7762025-02-13T05:15:56.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7772025-02-13T05:15:56.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
7782025-02-13T05:15:56.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7792025-02-13T05:15:56.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7802025-02-13T05:15:56.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.604463ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
7812025-02-13T05:15:56.309ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
7822025-02-13T05:15:56.309ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.684606ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
7832025-02-13T05:15:56.314ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7842025-02-13T05:15:56.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7852025-02-13T05:15:56.320ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7862025-02-13T05:15:56.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7872025-02-13T05:15:56.320ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7882025-02-13T05:15:56.320ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7892025-02-13T05:15:56.320ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7902025-02-13T05:15:56.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7912025-02-13T05:15:56.322ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7922025-02-13T05:15:56.322ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.20325ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7932025-02-13T05:15:56.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7942025-02-13T05:15:56.323ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7952025-02-13T05:15:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7962025-02-13T05:15:56.325ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7972025-02-13T05:15:56.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7982025-02-13T05:15:56.327ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7992025-02-13T05:15:56.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8002025-02-13T05:15:56.329ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8012025-02-13T05:15:56.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8022025-02-13T05:15:56.330ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8032025-02-13T05:15:56.330ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.742715ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8042025-02-13T05:15:56.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8052025-02-13T05:15:56.335ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8062025-02-13T05:15:56.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8072025-02-13T05:15:56.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8082025-02-13T05:15:56.338ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8092025-02-13T05:15:56.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8102025-02-13T05:15:56.342ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8112025-02-13T05:15:56.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8122025-02-13T05:15:56.355ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
8132025-02-13T05:15:56.355ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8142025-02-13T05:15:56.356ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b590ec8d-4f63-4d0b-ab03-e9f4f1323fe3", "content-length": "26", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
8152025-02-13T05:15:56.356ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8162025-02-13T05:15:56.357ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8172025-02-13T05:15:56.359ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8182025-02-13T05:15:56.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8192025-02-13T05:15:56.361ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8202025-02-13T05:15:56.361ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8212025-02-13T05:15:56.361ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.794418ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8222025-02-13T05:15:56.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 126.331834ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8232025-02-13T05:15:56.368ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8242025-02-13T05:15:56.369ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
8252025-02-13T05:15:56.369ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8262025-02-13T05:15:56.369ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "979074f0-4a2f-4fb2-a990-b91ad464658d", "content-length": "26", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
8272025-02-13T05:15:56.369ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8282025-02-13T05:15:56.370ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.261837ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8292025-02-13T05:15:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
8302025-02-13T05:15:56.371ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8312025-02-13T05:15:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8322025-02-13T05:15:56.371ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
8332025-02-13T05:15:56.383ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
8342025-02-13T05:15:56.383ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 141.881165ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8352025-02-13T05:15:56.388ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
8362025-02-13T05:15:56.388ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8372025-02-13T05:15:56.388ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddbb575b-4572-4bc7-851f-030c9f70697a", "content-length": "26", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
8382025-02-13T05:15:56.388ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8392025-02-13T05:15:56.390ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8402025-02-13T05:15:56.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8412025-02-13T05:15:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8422025-02-13T05:15:56.478ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8432025-02-13T05:15:56.478ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8442025-02-13T05:15:56.479ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf65f9a2-022b-4067-bda5-b28c6bc444fc", "content-length": "372", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
8452025-02-13T05:15:56.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8462025-02-13T05:15:56.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8472025-02-13T05:15:56.482ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 240.935303ms iteration = 16 status = 0
8482025-02-13T05:15:56.489ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8492025-02-13T05:15:56.489ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8ff1420-f2fb-48c1-9de3-68e965911faa", "content-length": "1", "date": "Thu, 13 Feb 2025 05:15:55 GMT"} })
8502025-02-13T05:15:56.492ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8512025-02-13T05:15:56.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8522025-02-13T05:15:56.495ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 254.110059ms iteration = 16 status = null
8532025-02-13T05:15:56.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8542025-02-13T05:15:56.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8552025-02-13T05:15:56.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8562025-02-13T05:15:56.510ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8572025-02-13T05:15:56.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8582025-02-13T05:15:56.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8592025-02-13T05:15:56.511ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 269.371743ms iteration = 16 status = {}
8602025-02-13T05:15:56.512ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8612025-02-13T05:15:56.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8622025-02-13T05:15:56.514ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8632025-02-13T05:15:56.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8642025-02-13T05:15:56.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 300.420876ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8652025-02-13T05:15:56.553ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8662025-02-13T05:15:56.553ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8672025-02-13T05:15:56.554ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d10c88b7-8429-438d-8693-8fed97ba3269", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
8682025-02-13T05:15:56.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8692025-02-13T05:15:56.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8702025-02-13T05:15:56.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8712025-02-13T05:15:56.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8722025-02-13T05:15:56.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8732025-02-13T05:15:56.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8742025-02-13T05:15:56.566ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8752025-02-13T05:15:56.566ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8762025-02-13T05:15:56.566ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "938be6c4-cd21-4b14-9ad9-2cfd915c88b3", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
8772025-02-13T05:15:56.568ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 326.9565ms iteration = 16 status = {}
8782025-02-13T05:15:56.601ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8792025-02-13T05:15:56.601ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5f09627-3f77-4d2e-ae5a-5c8655dc5d4b", "content-length": "691", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
8802025-02-13T05:15:56.601ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8812025-02-13T05:15:56.601ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8822025-02-13T05:15:56.601ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8832025-02-13T05:15:56.604ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 362.7962ms iteration = 16 status = {}
8842025-02-13T05:15:56.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8852025-02-13T05:15:56.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8862025-02-13T05:15:56.608ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
8872025-02-13T05:15:56.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8882025-02-13T05:15:56.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8892025-02-13T05:15:56.616ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 374.925995ms iteration = 17 status = {"physical_disks_added":0}
8902025-02-13T05:15:56.621ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8912025-02-13T05:15:56.621ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b0c0db1-ed23-453d-b85d-8c5fea51a05c", "content-length": "134", "date": "Thu, 13 Feb 2025 05:15:55 GMT"} })
8922025-02-13T05:15:56.621ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8932025-02-13T05:15:56.621ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
8942025-02-13T05:15:56.622ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8952025-02-13T05:15:56.622ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8962025-02-13T05:15:56.622ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8972025-02-13T05:15:56.622ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8982025-02-13T05:15:56.622ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8992025-02-13T05:15:56.622ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9002025-02-13T05:15:56.622ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9012025-02-13T05:15:56.622ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9022025-02-13T05:15:56.622ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
9032025-02-13T05:15:56.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9042025-02-13T05:15:56.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9052025-02-13T05:15:56.625ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9062025-02-13T05:15:56.625ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f1112f8-1933-4b19-b118-1fe15ca3c7ac", "content-length": "2", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
9072025-02-13T05:15:56.625ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9082025-02-13T05:15:56.625ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7589f743-9296-4cbe-b29d-0f04b08b86c3", "content-length": "52", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
9092025-02-13T05:15:56.625ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
9102025-02-13T05:15:56.625ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9112025-02-13T05:15:56.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9f0887f6-813b-4454-b6a7-4f7bacc1b5b9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9122025-02-13T05:15:56.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9f0887f6-813b-4454-b6a7-4f7bacc1b5b9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9132025-02-13T05:15:56.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2593 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9f0887f6-813b-4454-b6a7-4f7bacc1b5b9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9142025-02-13T05:15:56.862ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b984ccf6-4b46-4e05-b72e-ea141b14198b", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
9152025-02-13T05:15:56.862ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
9162025-02-13T05:15:56.862ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9172025-02-13T05:15:56.863ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a505e7cc-5c10-4541-99ef-d56c8413be0a", "content-length": "682", "date": "Thu, 13 Feb 2025 05:15:56 GMT"} })
9182025-02-13T05:15:56.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9192025-02-13T05:15:56.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9202025-02-13T05:15:56.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9212025-02-13T05:15:56.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9222025-02-13T05:15:56.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9232025-02-13T05:15:56.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9242025-02-13T05:15:56.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9252025-02-13T05:15:56.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9262025-02-13T05:15:56.886ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 645.265444ms iteration = 16 status = {}
9272025-02-13T05:15:57.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 83867ad7-f58c-4bb9-ad55-ec2826f0900e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9282025-02-13T05:15:57.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 83867ad7-f58c-4bb9-ad55-ec2826f0900e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9292025-02-13T05:15:57.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 83867ad7-f58c-4bb9-ad55-ec2826f0900e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9302025-02-13T05:15:58.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 300aedf6-0451-4b90-89bb-94ead7ced7d7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9312025-02-13T05:15:58.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 300aedf6-0451-4b90-89bb-94ead7ced7d7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9322025-02-13T05:15:58.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2630 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 300aedf6-0451-4b90-89bb-94ead7ced7d7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9332025-02-13T05:15:59.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3509e283-451c-451a-82de-7026dbd04af8 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9342025-02-13T05:15:59.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3509e283-451c-451a-82de-7026dbd04af8 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9352025-02-13T05:15:59.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2509 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3509e283-451c-451a-82de-7026dbd04af8 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9362025-02-13T05:16:00.163ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 607 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 0d5d1f02-4443-4ae3-9d32-0c4a9b93632b response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
9372025-02-13T05:16:00.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 327e5af7-a7ca-4cb5-9c01-141994337b50 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9382025-02-13T05:16:00.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 327e5af7-a7ca-4cb5-9c01-141994337b50 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9392025-02-13T05:16:00.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 327e5af7-a7ca-4cb5-9c01-141994337b50 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9402025-02-13T05:16:01.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fee4f3cf-feac-4a60-8335-cd5e7c202f94 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9412025-02-13T05:16:01.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fee4f3cf-feac-4a60-8335-cd5e7c202f94 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9422025-02-13T05:16:01.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2004 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fee4f3cf-feac-4a60-8335-cd5e7c202f94 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9432025-02-13T05:16:02.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = faf9db48-ed8f-41a9-9936-8a6ed4a04f80 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9442025-02-13T05:16:02.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = faf9db48-ed8f-41a9-9936-8a6ed4a04f80 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9452025-02-13T05:16:02.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2561 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = faf9db48-ed8f-41a9-9936-8a6ed4a04f80 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9462025-02-13T05:16:03.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 84cc0a58-20dd-410c-80b3-37dc477aafce roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9472025-02-13T05:16:03.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 84cc0a58-20dd-410c-80b3-37dc477aafce resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9482025-02-13T05:16:03.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 84cc0a58-20dd-410c-80b3-37dc477aafce response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9492025-02-13T05:16:04.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a39b970f-1ea3-4a7c-b963-6ddd256e262b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9502025-02-13T05:16:04.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a39b970f-1ea3-4a7c-b963-6ddd256e262b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9512025-02-13T05:16:04.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2081 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a39b970f-1ea3-4a7c-b963-6ddd256e262b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9522025-02-13T05:16:05.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 520c6797-2f29-4f44-ba64-0353508d7eb2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9532025-02-13T05:16:05.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 520c6797-2f29-4f44-ba64-0353508d7eb2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9542025-02-13T05:16:05.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1803 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 520c6797-2f29-4f44-ba64-0353508d7eb2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9552025-02-13T05:16:06.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
9562025-02-13T05:16:06.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
9572025-02-13T05:16:06.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9582025-02-13T05:16:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9592025-02-13T05:16:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9602025-02-13T05:16:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9612025-02-13T05:16:06.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9622025-02-13T05:16:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9632025-02-13T05:16:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9642025-02-13T05:16:06.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.22388ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9652025-02-13T05:16:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9662025-02-13T05:16:06.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9672025-02-13T05:16:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9682025-02-13T05:16:06.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9692025-02-13T05:16:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9702025-02-13T05:16:06.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9712025-02-13T05:16:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
9722025-02-13T05:16:06.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9732025-02-13T05:16:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9742025-02-13T05:16:06.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
9752025-02-13T05:16:06.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.837358ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
9762025-02-13T05:16:06.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4bb8b2aa-1733-455d-a67d-0b342b8ed161 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9772025-02-13T05:16:06.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4bb8b2aa-1733-455d-a67d-0b342b8ed161 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9782025-02-13T05:16:06.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1949 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4bb8b2aa-1733-455d-a67d-0b342b8ed161 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9792025-02-13T05:16:07.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cf2e7218-e969-4dc2-a8ca-755d05d8bf31 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9802025-02-13T05:16:07.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cf2e7218-e969-4dc2-a8ca-755d05d8bf31 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9812025-02-13T05:16:07.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1801 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cf2e7218-e969-4dc2-a8ca-755d05d8bf31 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9822025-02-13T05:16:09.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 47b73b4f-4586-4565-b1b5-a09de9bc1fcd roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9832025-02-13T05:16:09.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 47b73b4f-4586-4565-b1b5-a09de9bc1fcd resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9842025-02-13T05:16:09.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2674 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 47b73b4f-4586-4565-b1b5-a09de9bc1fcd response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9852025-02-13T05:16:10.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 65020c38-d167-43a2-9ca8-c342c3ce8d5f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9862025-02-13T05:16:10.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 65020c38-d167-43a2-9ca8-c342c3ce8d5f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9872025-02-13T05:16:10.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2025 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 65020c38-d167-43a2-9ca8-c342c3ce8d5f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9882025-02-13T05:16:10.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 48e28a9a-1fd8-4f2e-9823-9eeca55764a9 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
9892025-02-13T05:16:10.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 48e28a9a-1fd8-4f2e-9823-9eeca55764a9 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
9902025-02-13T05:16:10.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2614 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 48e28a9a-1fd8-4f2e-9823-9eeca55764a9 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
9912025-02-13T05:16:10.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 78eaba78-ef75-46f6-a954-b26d7f54a26f roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
9922025-02-13T05:16:10.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 78eaba78-ef75-46f6-a954-b26d7f54a26f resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
9932025-02-13T05:16:10.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 78eaba78-ef75-46f6-a954-b26d7f54a26f response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
9942025-02-13T05:16:10.163ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 406 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 8f979d18-48a9-4589-9736-9ba0ffbc32f0 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
9952025-02-13T05:16:11.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d5f3bdc9-099f-4855-87ef-9c4078f9786e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9962025-02-13T05:16:11.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d5f3bdc9-099f-4855-87ef-9c4078f9786e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9972025-02-13T05:16:11.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2017 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d5f3bdc9-099f-4855-87ef-9c4078f9786e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9982025-02-13T05:16:12.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 53d4c5a1-5aac-4b81-8593-bb56e5686308 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
9992025-02-13T05:16:12.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 53d4c5a1-5aac-4b81-8593-bb56e5686308 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10002025-02-13T05:16:12.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1899 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 53d4c5a1-5aac-4b81-8593-bb56e5686308 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10012025-02-13T05:16:13.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7e69e29d-993c-4f2f-98b7-b7e33b39b050 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10022025-02-13T05:16:13.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7e69e29d-993c-4f2f-98b7-b7e33b39b050 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10032025-02-13T05:16:13.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1755 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7e69e29d-993c-4f2f-98b7-b7e33b39b050 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10042025-02-13T05:16:14.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4ec0ebd9-54dc-44d5-942c-2e3b69e2fe2d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10052025-02-13T05:16:14.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4ec0ebd9-54dc-44d5-942c-2e3b69e2fe2d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10062025-02-13T05:16:14.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1934 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4ec0ebd9-54dc-44d5-942c-2e3b69e2fe2d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10072025-02-13T05:16:15.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fee40c6e-0e75-4d38-8d41-c174614a44c8 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10082025-02-13T05:16:15.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fee40c6e-0e75-4d38-8d41-c174614a44c8 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10092025-02-13T05:16:15.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2664 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fee40c6e-0e75-4d38-8d41-c174614a44c8 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10102025-02-13T05:16:16.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 999ea06b-16b9-4fb3-b45c-d34b7f01fde0 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10112025-02-13T05:16:16.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 999ea06b-16b9-4fb3-b45c-d34b7f01fde0 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10122025-02-13T05:16:16.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1845 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 999ea06b-16b9-4fb3-b45c-d34b7f01fde0 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10132025-02-13T05:16:16.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
10142025-02-13T05:16:16.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
10152025-02-13T05:16:16.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10162025-02-13T05:16:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10172025-02-13T05:16:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10182025-02-13T05:16:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10192025-02-13T05:16:16.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10202025-02-13T05:16:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10212025-02-13T05:16:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10222025-02-13T05:16:16.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.273033ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10232025-02-13T05:16:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10242025-02-13T05:16:16.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10252025-02-13T05:16:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10262025-02-13T05:16:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10272025-02-13T05:16:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10282025-02-13T05:16:16.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10292025-02-13T05:16:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
10302025-02-13T05:16:16.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10312025-02-13T05:16:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10322025-02-13T05:16:16.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
10332025-02-13T05:16:16.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.675529ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
10342025-02-13T05:16:17.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 666ecb64-3648-429e-8e3e-7f5f01705466 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10352025-02-13T05:16:17.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 666ecb64-3648-429e-8e3e-7f5f01705466 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10362025-02-13T05:16:17.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 666ecb64-3648-429e-8e3e-7f5f01705466 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10372025-02-13T05:16:18.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3ac7ff59-217c-4acc-8271-7155df133ce3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10382025-02-13T05:16:18.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3ac7ff59-217c-4acc-8271-7155df133ce3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10392025-02-13T05:16:18.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3ac7ff59-217c-4acc-8271-7155df133ce3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10402025-02-13T05:16:19.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 60ef347c-70f7-487c-9fa7-ac8f2cdcba65 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10412025-02-13T05:16:19.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 60ef347c-70f7-487c-9fa7-ac8f2cdcba65 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10422025-02-13T05:16:19.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 60ef347c-70f7-487c-9fa7-ac8f2cdcba65 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10432025-02-13T05:16:20.163ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 412 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = acf7fb78-a863-4fa0-b14d-2ce57827a52f response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
10442025-02-13T05:16:20.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 55f02320-5b4f-43c1-a304-976b236ff040 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10452025-02-13T05:16:20.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 55f02320-5b4f-43c1-a304-976b236ff040 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10462025-02-13T05:16:20.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 55f02320-5b4f-43c1-a304-976b236ff040 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10472025-02-13T05:16:21.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bcf855fb-13d7-4d04-86cf-8ae96a5f4f2b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10482025-02-13T05:16:21.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bcf855fb-13d7-4d04-86cf-8ae96a5f4f2b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10492025-02-13T05:16:21.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2295 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bcf855fb-13d7-4d04-86cf-8ae96a5f4f2b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10502025-02-13T05:16:22.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 125eb014-d6d0-45ec-81f4-e8da424dd4c7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10512025-02-13T05:16:22.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 125eb014-d6d0-45ec-81f4-e8da424dd4c7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10522025-02-13T05:16:22.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1986 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 125eb014-d6d0-45ec-81f4-e8da424dd4c7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10532025-02-13T05:16:23.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 45ea8c56-06ca-4ada-86d3-5b927dc26ad8 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10542025-02-13T05:16:23.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 45ea8c56-06ca-4ada-86d3-5b927dc26ad8 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10552025-02-13T05:16:23.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2641 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 45ea8c56-06ca-4ada-86d3-5b927dc26ad8 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10562025-02-13T05:16:24.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bb326139-c0fb-4c1e-a1e2-4ba864828512 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10572025-02-13T05:16:24.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bb326139-c0fb-4c1e-a1e2-4ba864828512 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10582025-02-13T05:16:24.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1647 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bb326139-c0fb-4c1e-a1e2-4ba864828512 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10592025-02-13T05:16:25.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 1237556c-77a2-42c6-aaf0-5ba8b8290e19 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
10602025-02-13T05:16:25.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 1237556c-77a2-42c6-aaf0-5ba8b8290e19 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
10612025-02-13T05:16:25.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3155 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 1237556c-77a2-42c6-aaf0-5ba8b8290e19 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
10622025-02-13T05:16:25.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = f35a1594-cfae-41d4-adf1-4b16987eb40a roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
10632025-02-13T05:16:25.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = f35a1594-cfae-41d4-adf1-4b16987eb40a resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
10642025-02-13T05:16:25.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = f35a1594-cfae-41d4-adf1-4b16987eb40a response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
10652025-02-13T05:16:25.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f7d29d82-a917-4f26-aa6d-2548ee40ab09 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10662025-02-13T05:16:25.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f7d29d82-a917-4f26-aa6d-2548ee40ab09 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10672025-02-13T05:16:25.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f7d29d82-a917-4f26-aa6d-2548ee40ab09 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
10682025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
10692025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10702025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
10712025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10722025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
10732025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10742025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
10752025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10762025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
10772025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10782025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
10792025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10802025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10812025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
10822025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10832025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
10842025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
10852025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10862025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
10872025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
10882025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10892025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
10902025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
10912025-02-13T05:16:26.241ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = e132683f-3ab0-4513-890f-86716ec9a9cf
10922025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10932025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.551\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf"}
10942025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
10952025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
10962025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
10972025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10982025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10992025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
11002025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
11012025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11022025-02-13T05:16:26.241ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-13 05:06:26.241340311 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11032025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
11042025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
11052025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11062025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11072025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
11082025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
11092025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11102025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
11112025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11122025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
11132025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
11142025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11152025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11162025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
11172025-02-13T05:16:26.241ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
11182025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11192025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
11202025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
11212025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
11222025-02-13T05:16:26.241ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11232025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
11242025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
11252025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11262025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11272025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
11282025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
11292025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11302025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11312025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11322025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11332025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
11342025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11352025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11362025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11372025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11382025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11392025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11402025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
11412025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11422025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11432025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
11442025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11452025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11462025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11472025-02-13T05:16:26.241ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec95727a-7af6-45d1-9962-81bf544db84b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 780425023 } })
11482025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11492025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11502025-02-13T05:16:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11512025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11522025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11532025-02-13T05:16:26.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9f4eb8b3-c464-433c-b912-c7432c124258.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cc24f910-ffb5-4de8-b7e1-4b9d4d15a7cd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 780527935 } })
11542025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11552025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11562025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11572025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11582025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11592025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11602025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
11612025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11622025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
11632025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.080471ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
11642025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
11652025-02-13T05:16:26.242ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.237845ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
11662025-02-13T05:16:26.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 782035748 } })
11672025-02-13T05:16:26.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
11682025-02-13T05:16:26.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11692025-02-13T05:16:26.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11702025-02-13T05:16:26.245ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.83868ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11712025-02-13T05:16:26.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.288302ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
11722025-02-13T05:16:26.246ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.069474ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
11732025-02-13T05:16:26.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11742025-02-13T05:16:26.246ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11752025-02-13T05:16:26.246ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11762025-02-13T05:16:26.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11772025-02-13T05:16:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11782025-02-13T05:16:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11792025-02-13T05:16:26.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11802025-02-13T05:16:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11812025-02-13T05:16:26.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11822025-02-13T05:16:26.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11832025-02-13T05:16:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11842025-02-13T05:16:26.249ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-13 05:06:26.241340311 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11852025-02-13T05:16:26.249ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.051179ms iteration = 9 status = {"expiration":"2025-02-13T05:06:26.241340311Z","pruned":[]}
11862025-02-13T05:16:26.249ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11872025-02-13T05:16:26.249ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11882025-02-13T05:16:26.249ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11892025-02-13T05:16:26.249ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.520943ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11902025-02-13T05:16:26.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11912025-02-13T05:16:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11922025-02-13T05:16:26.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11932025-02-13T05:16:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11942025-02-13T05:16:26.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11952025-02-13T05:16:26.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11962025-02-13T05:16:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11972025-02-13T05:16:26.252ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11982025-02-13T05:16:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11992025-02-13T05:16:26.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12002025-02-13T05:16:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12012025-02-13T05:16:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12022025-02-13T05:16:26.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12032025-02-13T05:16:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12042025-02-13T05:16:26.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12052025-02-13T05:16:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12062025-02-13T05:16:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12072025-02-13T05:16:26.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12082025-02-13T05:16:26.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12092025-02-13T05:16:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12102025-02-13T05:16:26.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12112025-02-13T05:16:26.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12122025-02-13T05:16:26.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12132025-02-13T05:16:26.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12142025-02-13T05:16:26.259ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12152025-02-13T05:16:26.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12162025-02-13T05:16:26.261ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12172025-02-13T05:16:26.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12182025-02-13T05:16:26.264ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 803092947 } })
12192025-02-13T05:16:26.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12202025-02-13T05:16:26.266ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
12212025-02-13T05:16:26.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12222025-02-13T05:16:26.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12232025-02-13T05:16:26.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12242025-02-13T05:16:26.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12252025-02-13T05:16:26.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12262025-02-13T05:16:26.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12272025-02-13T05:16:26.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12282025-02-13T05:16:26.274ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12292025-02-13T05:16:26.274ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 33.602866ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12302025-02-13T05:16:26.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 33.888874ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12312025-02-13T05:16:26.275ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12322025-02-13T05:16:26.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12332025-02-13T05:16:26.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12342025-02-13T05:16:26.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12352025-02-13T05:16:26.279ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12362025-02-13T05:16:26.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12372025-02-13T05:16:26.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12382025-02-13T05:16:26.284ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12392025-02-13T05:16:26.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12402025-02-13T05:16:26.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12412025-02-13T05:16:26.293ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12422025-02-13T05:16:26.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12432025-02-13T05:16:26.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12442025-02-13T05:16:26.297ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12452025-02-13T05:16:26.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12462025-02-13T05:16:26.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12472025-02-13T05:16:26.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12482025-02-13T05:16:26.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12492025-02-13T05:16:26.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.345763ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
12502025-02-13T05:16:26.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12512025-02-13T05:16:26.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12522025-02-13T05:16:26.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12532025-02-13T05:16:26.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12542025-02-13T05:16:26.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12552025-02-13T05:16:26.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12562025-02-13T05:16:26.328ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12572025-02-13T05:16:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12582025-02-13T05:16:26.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.774567ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12592025-02-13T05:16:26.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12602025-02-13T05:16:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12612025-02-13T05:16:26.350ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 109.136534ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
12622025-02-13T05:16:26.350ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12632025-02-13T05:16:26.350ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12642025-02-13T05:16:26.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12652025-02-13T05:16:26.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12662025-02-13T05:16:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12672025-02-13T05:16:26.352ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12682025-02-13T05:16:26.352ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
12692025-02-13T05:16:26.352ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 110.826863ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
12702025-02-13T05:16:26.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12712025-02-13T05:16:26.353ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12722025-02-13T05:16:26.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12732025-02-13T05:16:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12742025-02-13T05:16:26.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.379553ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12752025-02-13T05:16:26.356ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12762025-02-13T05:16:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
12772025-02-13T05:16:26.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12782025-02-13T05:16:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12792025-02-13T05:16:26.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12802025-02-13T05:16:26.372ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12812025-02-13T05:16:26.380ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
12822025-02-13T05:16:26.385ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
12832025-02-13T05:16:26.385ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12842025-02-13T05:16:26.385ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf7f468d-eec7-4331-b2b9-9ed7fc051bfd", "content-length": "26", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
12852025-02-13T05:16:26.385ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12862025-02-13T05:16:26.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e8b5321a-86bc-4966-ac3d-07aca8f66af2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
12872025-02-13T05:16:26.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e8b5321a-86bc-4966-ac3d-07aca8f66af2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
12882025-02-13T05:16:26.387ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12892025-02-13T05:16:26.389ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12902025-02-13T05:16:26.389ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12912025-02-13T05:16:26.389ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12922025-02-13T05:16:26.389ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12932025-02-13T05:16:26.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12942025-02-13T05:16:26.397ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12952025-02-13T05:16:26.397ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12962025-02-13T05:16:26.397ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12972025-02-13T05:16:26.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12982025-02-13T05:16:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12992025-02-13T05:16:26.454ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13002025-02-13T05:16:26.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13012025-02-13T05:16:26.471ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 230.140767ms iteration = 18 status = {"physical_disks_added":0}
13022025-02-13T05:16:26.475ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
13032025-02-13T05:16:26.475ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13042025-02-13T05:16:26.476ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "767e896b-fe04-44e9-aeb9-f602939b172e", "content-length": "26", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
13052025-02-13T05:16:26.476ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13062025-02-13T05:16:26.478ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13072025-02-13T05:16:26.480ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13082025-02-13T05:16:26.480ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13092025-02-13T05:16:26.480ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3153d470-98c3-4281-a3dd-f70d264e34da", "content-length": "372", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
13102025-02-13T05:16:26.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13112025-02-13T05:16:26.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13122025-02-13T05:16:26.492ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1296, tv_nsec: 31241817 } })
13132025-02-13T05:16:26.493ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
13142025-02-13T05:16:26.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13152025-02-13T05:16:26.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13162025-02-13T05:16:26.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111354 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e8b5321a-86bc-4966-ac3d-07aca8f66af2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
13172025-02-13T05:16:26.498ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13182025-02-13T05:16:26.500ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13192025-02-13T05:16:26.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13202025-02-13T05:16:26.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13212025-02-13T05:16:26.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
13222025-02-13T05:16:26.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13232025-02-13T05:16:26.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13242025-02-13T05:16:26.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13252025-02-13T05:16:26.519ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 278.199173ms iteration = 17 status = 0
13262025-02-13T05:16:26.526ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
13272025-02-13T05:16:26.526ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 285.552643ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
13282025-02-13T05:16:26.531ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13292025-02-13T05:16:26.532ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0305b1c3-57b9-40c1-8e43-67bfbdd98bf9", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13302025-02-13T05:16:26.532ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13312025-02-13T05:16:26.535ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "72a673de-87d8-4d26-a600-0379da820f48", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13322025-02-13T05:16:26.535ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13332025-02-13T05:16:26.537ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13342025-02-13T05:16:26.537ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 295.986429ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13352025-02-13T05:16:26.549ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13362025-02-13T05:16:26.550ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13372025-02-13T05:16:26.550ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 308.830725ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
13382025-02-13T05:16:26.552ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13392025-02-13T05:16:26.553ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13402025-02-13T05:16:26.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13412025-02-13T05:16:26.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13422025-02-13T05:16:26.555ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13432025-02-13T05:16:26.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13442025-02-13T05:16:26.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13452025-02-13T05:16:26.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13462025-02-13T05:16:26.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 321.337761ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
13472025-02-13T05:16:26.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13482025-02-13T05:16:26.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13492025-02-13T05:16:26.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13502025-02-13T05:16:26.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13512025-02-13T05:16:26.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13522025-02-13T05:16:26.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13532025-02-13T05:16:26.567ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13542025-02-13T05:16:26.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13552025-02-13T05:16:26.574ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13562025-02-13T05:16:26.575ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1080dab9-4a8d-4bbd-8572-55277cfa2e5e", "content-length": "1", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
13572025-02-13T05:16:26.575ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13582025-02-13T05:16:26.575ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 0 version = 2
13592025-02-13T05:16:26.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13602025-02-13T05:16:26.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13612025-02-13T05:16:26.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13622025-02-13T05:16:26.577ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13632025-02-13T05:16:26.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13642025-02-13T05:16:26.578ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13652025-02-13T05:16:26.578ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13662025-02-13T05:16:26.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13672025-02-13T05:16:26.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13682025-02-13T05:16:26.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13692025-02-13T05:16:26.580ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 339.355364ms iteration = 17 status = null
13702025-02-13T05:16:26.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13712025-02-13T05:16:26.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13722025-02-13T05:16:26.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13732025-02-13T05:16:26.585ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 1 version = 2
13742025-02-13T05:16:26.585ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13752025-02-13T05:16:26.585ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-13 05:08:27.963644 UTC dns_group = external generation = 2
13762025-02-13T05:16:26.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 344.574342ms iteration = 9 status = {"generation":2}
13772025-02-13T05:16:26.597ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
13782025-02-13T05:16:26.597ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13792025-02-13T05:16:26.597ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a39a5c8c-03db-481f-9220-e70195db97b2", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
13802025-02-13T05:16:26.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13812025-02-13T05:16:26.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13822025-02-13T05:16:26.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13832025-02-13T05:16:26.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13842025-02-13T05:16:26.603ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 361.992787ms iteration = 17 status = {}
13852025-02-13T05:16:26.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13862025-02-13T05:16:26.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13872025-02-13T05:16:26.605ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13882025-02-13T05:16:26.605ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13892025-02-13T05:16:26.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13902025-02-13T05:16:26.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13912025-02-13T05:16:26.610ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13922025-02-13T05:16:26.610ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13932025-02-13T05:16:26.610ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fda1e233-bd68-4868-82b5-d6132bd0c1d6", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
13942025-02-13T05:16:26.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13952025-02-13T05:16:26.611ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 370.50938ms iteration = 17 status = {}
13962025-02-13T05:16:26.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13972025-02-13T05:16:26.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13982025-02-13T05:16:26.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13992025-02-13T05:16:26.616ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
14002025-02-13T05:16:26.616ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 375.207613ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
14012025-02-13T05:16:26.617ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
14022025-02-13T05:16:26.617ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
14032025-02-13T05:16:26.617ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-13 05:08:26.528706 UTC dns_group = internal generation = 1
14042025-02-13T05:16:26.617ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 376.564232ms iteration = 9 status = {"generation":1}
14052025-02-13T05:16:26.619ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-13T05:08:23.439194Z, time_modified: 2025-02-13T05:08:23.439194Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }) }
14062025-02-13T05:16:26.619ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 377.744355ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]}},"default_endpoint":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
14072025-02-13T05:16:26.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14082025-02-13T05:16:26.625ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14092025-02-13T05:16:26.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14102025-02-13T05:16:26.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14112025-02-13T05:16:26.646ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
14122025-02-13T05:16:26.647ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 405.794773ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
14132025-02-13T05:16:26.677ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
14142025-02-13T05:16:26.677ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14152025-02-13T05:16:26.677ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10b803af-ea55-4192-b021-13021ff996d6", "content-length": "26", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
14162025-02-13T05:16:26.677ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14172025-02-13T05:16:26.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
14182025-02-13T05:16:26.692ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14192025-02-13T05:16:26.692ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5e616ae5-ea54-4247-a2f9-5ff1137708ae", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14202025-02-13T05:16:26.692ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14212025-02-13T05:16:26.695ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8edb5536-ed53-4548-9c3c-6e7e65536912", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14222025-02-13T05:16:26.695ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14232025-02-13T05:16:26.696ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e71bc35b-52a8-4845-9613-ee29dc7bd8c2", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14242025-02-13T05:16:26.696ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14252025-02-13T05:16:26.698ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14262025-02-13T05:16:26.698ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 457.36961ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14272025-02-13T05:16:26.772ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14282025-02-13T05:16:26.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14292025-02-13T05:16:26.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14302025-02-13T05:16:26.817ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
14312025-02-13T05:16:26.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14322025-02-13T05:16:26.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14332025-02-13T05:16:26.827ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14342025-02-13T05:16:26.827ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "516841c0-a4bf-4f1d-a233-f98291ac9d10", "content-length": "134", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
14352025-02-13T05:16:26.827ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
14362025-02-13T05:16:26.827ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
14372025-02-13T05:16:26.828ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14382025-02-13T05:16:26.828ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14392025-02-13T05:16:26.828ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14402025-02-13T05:16:26.828ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14412025-02-13T05:16:26.828ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14422025-02-13T05:16:26.828ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14432025-02-13T05:16:26.828ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14442025-02-13T05:16:26.828ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14452025-02-13T05:16:26.828ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
14462025-02-13T05:16:26.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14472025-02-13T05:16:26.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14482025-02-13T05:16:26.830ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14492025-02-13T05:16:26.830ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba6511fa-a2fa-4c4f-ac5f-725918c99e14", "content-length": "2", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
14502025-02-13T05:16:26.830ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14512025-02-13T05:16:26.831ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bcf276f-697f-4c3d-9aa2-99b6066bff1d", "content-length": "52", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
14522025-02-13T05:16:26.831ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
14532025-02-13T05:16:26.831ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14542025-02-13T05:16:26.865ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "706604a4-9722-45ac-b4c4-fecf47802108", "content-length": "691", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
14552025-02-13T05:16:26.865ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14562025-02-13T05:16:26.865ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14572025-02-13T05:16:26.865ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14582025-02-13T05:16:26.867ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 626.276445ms iteration = 17 status = {}
14592025-02-13T05:16:26.956ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c570b7ad-e3ba-45c8-b763-7cf56895bace", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
14602025-02-13T05:16:26.956ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
14612025-02-13T05:16:26.956ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14622025-02-13T05:16:26.959ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0afedc8e-804a-4f73-adff-d464bf7f0efd", "content-length": "682", "date": "Thu, 13 Feb 2025 05:16:26 GMT"} })
14632025-02-13T05:16:26.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14642025-02-13T05:16:26.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14652025-02-13T05:16:26.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14662025-02-13T05:16:26.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14672025-02-13T05:16:26.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14682025-02-13T05:16:26.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14692025-02-13T05:16:26.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14702025-02-13T05:16:26.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14712025-02-13T05:16:26.976ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 735.322737ms iteration = 17 status = {}
14722025-02-13T05:16:27.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9e1a6ad6-adaf-4ea9-bbb5-a524ed17d1fd roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14732025-02-13T05:16:27.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9e1a6ad6-adaf-4ea9-bbb5-a524ed17d1fd resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14742025-02-13T05:16:27.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2524 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9e1a6ad6-adaf-4ea9-bbb5-a524ed17d1fd response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14752025-02-13T05:16:28.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cd0d5984-f660-4871-9ff6-08e334850248 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14762025-02-13T05:16:28.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cd0d5984-f660-4871-9ff6-08e334850248 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14772025-02-13T05:16:28.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cd0d5984-f660-4871-9ff6-08e334850248 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14782025-02-13T05:16:29.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 16ce8dca-8e96-4389-a177-e8b00d67be46 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14792025-02-13T05:16:29.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 16ce8dca-8e96-4389-a177-e8b00d67be46 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14802025-02-13T05:16:29.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1983 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 16ce8dca-8e96-4389-a177-e8b00d67be46 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14812025-02-13T05:16:30.163ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 374 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = b04e4105-b26b-4c49-be85-57602f757d40 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
14822025-02-13T05:16:30.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5abfbdde-5abd-484b-a4d9-9d1c5856ce12 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14832025-02-13T05:16:30.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5abfbdde-5abd-484b-a4d9-9d1c5856ce12 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14842025-02-13T05:16:30.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5abfbdde-5abd-484b-a4d9-9d1c5856ce12 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14852025-02-13T05:16:31.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5081261f-60b3-4339-988c-d7526c26d085 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14862025-02-13T05:16:31.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5081261f-60b3-4339-988c-d7526c26d085 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14872025-02-13T05:16:31.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2449 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5081261f-60b3-4339-988c-d7526c26d085 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14882025-02-13T05:16:32.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 83de4240-ccb9-445a-8ce8-9da0f13775b4 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14892025-02-13T05:16:32.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 83de4240-ccb9-445a-8ce8-9da0f13775b4 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14902025-02-13T05:16:32.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 83de4240-ccb9-445a-8ce8-9da0f13775b4 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14912025-02-13T05:16:33.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5bed6dd1-a2a4-484e-b6b4-c837e720af87 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14922025-02-13T05:16:33.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5bed6dd1-a2a4-484e-b6b4-c837e720af87 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14932025-02-13T05:16:33.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1832 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5bed6dd1-a2a4-484e-b6b4-c837e720af87 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14942025-02-13T05:16:34.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ff300ccc-7a46-4595-8bbe-d480ce51d0f7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14952025-02-13T05:16:34.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ff300ccc-7a46-4595-8bbe-d480ce51d0f7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14962025-02-13T05:16:34.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1818 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ff300ccc-7a46-4595-8bbe-d480ce51d0f7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14972025-02-13T05:16:35.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 12b8ffd5-f15c-4b16-92a9-93b8de085f4b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14982025-02-13T05:16:35.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 12b8ffd5-f15c-4b16-92a9-93b8de085f4b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
14992025-02-13T05:16:35.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 12b8ffd5-f15c-4b16-92a9-93b8de085f4b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15002025-02-13T05:16:36.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
15012025-02-13T05:16:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
15022025-02-13T05:16:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15032025-02-13T05:16:36.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15042025-02-13T05:16:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15052025-02-13T05:16:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15062025-02-13T05:16:36.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15072025-02-13T05:16:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15082025-02-13T05:16:36.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15092025-02-13T05:16:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15102025-02-13T05:16:36.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15112025-02-13T05:16:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15122025-02-13T05:16:36.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15132025-02-13T05:16:36.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
15142025-02-13T05:16:36.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15152025-02-13T05:16:36.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15162025-02-13T05:16:36.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
15172025-02-13T05:16:36.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.553481ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
15182025-02-13T05:16:36.271ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15192025-02-13T05:16:36.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15202025-02-13T05:16:36.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.719069ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15212025-02-13T05:16:36.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e6641f86-fd3c-4587-b2d1-8364c3d61f06 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15222025-02-13T05:16:36.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e6641f86-fd3c-4587-b2d1-8364c3d61f06 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15232025-02-13T05:16:36.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e6641f86-fd3c-4587-b2d1-8364c3d61f06 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15242025-02-13T05:16:37.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 61c433fb-78ec-448c-97b8-303fb9348bf3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15252025-02-13T05:16:37.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 61c433fb-78ec-448c-97b8-303fb9348bf3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15262025-02-13T05:16:37.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 61c433fb-78ec-448c-97b8-303fb9348bf3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15272025-02-13T05:16:38.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 90aebbea-b042-4170-b6cd-b23e2a70374e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15282025-02-13T05:16:38.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 90aebbea-b042-4170-b6cd-b23e2a70374e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15292025-02-13T05:16:38.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1844 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 90aebbea-b042-4170-b6cd-b23e2a70374e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15302025-02-13T05:16:39.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 27fe7083-b52e-4fb6-9be0-f1af0602ad70 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15312025-02-13T05:16:39.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 27fe7083-b52e-4fb6-9be0-f1af0602ad70 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15322025-02-13T05:16:39.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 27fe7083-b52e-4fb6-9be0-f1af0602ad70 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15332025-02-13T05:16:40.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 13d8cfe9-8e01-42ce-847b-939a7e5a34aa roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
15342025-02-13T05:16:40.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 13d8cfe9-8e01-42ce-847b-939a7e5a34aa resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
15352025-02-13T05:16:40.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3126 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 13d8cfe9-8e01-42ce-847b-939a7e5a34aa response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
15362025-02-13T05:16:40.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 00d4b219-94a4-4515-8b18-00bd48bf381e roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
15372025-02-13T05:16:40.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 00d4b219-94a4-4515-8b18-00bd48bf381e resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
15382025-02-13T05:16:40.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2958 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 00d4b219-94a4-4515-8b18-00bd48bf381e response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
15392025-02-13T05:16:40.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 423 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 0d3975f6-bffb-4cf8-93b0-c656b59bd18a response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
15402025-02-13T05:16:40.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 205cc90c-c6ac-4a6f-ac4b-7b3c51d842ba roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15412025-02-13T05:16:40.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 205cc90c-c6ac-4a6f-ac4b-7b3c51d842ba resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15422025-02-13T05:16:40.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 205cc90c-c6ac-4a6f-ac4b-7b3c51d842ba response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15432025-02-13T05:16:41.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d85f8f06-d0ba-45d3-950f-8676aecef785 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15442025-02-13T05:16:41.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d85f8f06-d0ba-45d3-950f-8676aecef785 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15452025-02-13T05:16:41.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1543 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d85f8f06-d0ba-45d3-950f-8676aecef785 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15462025-02-13T05:16:42.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 390d534e-8a10-4485-a36b-b8d93acd14d7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15472025-02-13T05:16:42.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 390d534e-8a10-4485-a36b-b8d93acd14d7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15482025-02-13T05:16:42.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2650 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 390d534e-8a10-4485-a36b-b8d93acd14d7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15492025-02-13T05:16:43.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2ab37cfd-9553-42fa-8767-3db276c8f345 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15502025-02-13T05:16:43.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2ab37cfd-9553-42fa-8767-3db276c8f345 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15512025-02-13T05:16:43.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2ab37cfd-9553-42fa-8767-3db276c8f345 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15522025-02-13T05:16:44.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 654266c5-0eea-4705-8742-bf3f4e2648f4 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15532025-02-13T05:16:44.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 654266c5-0eea-4705-8742-bf3f4e2648f4 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15542025-02-13T05:16:44.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 654266c5-0eea-4705-8742-bf3f4e2648f4 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15552025-02-13T05:16:45.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 78880e23-b1a4-4c5d-8811-7e8e0408f0e1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15562025-02-13T05:16:45.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 78880e23-b1a4-4c5d-8811-7e8e0408f0e1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15572025-02-13T05:16:45.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 78880e23-b1a4-4c5d-8811-7e8e0408f0e1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15582025-02-13T05:16:46.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
15592025-02-13T05:16:46.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
15602025-02-13T05:16:46.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15612025-02-13T05:16:46.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15622025-02-13T05:16:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15632025-02-13T05:16:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15642025-02-13T05:16:46.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15652025-02-13T05:16:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15662025-02-13T05:16:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15672025-02-13T05:16:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15682025-02-13T05:16:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15692025-02-13T05:16:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15702025-02-13T05:16:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712025-02-13T05:16:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
15722025-02-13T05:16:46.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15732025-02-13T05:16:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15742025-02-13T05:16:46.268ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
15752025-02-13T05:16:46.268ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.336138ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
15762025-02-13T05:16:46.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15772025-02-13T05:16:46.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15782025-02-13T05:16:46.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.586911ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15792025-02-13T05:16:46.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4982e994-4088-42ad-afc9-faf7f665a9de roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15802025-02-13T05:16:46.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4982e994-4088-42ad-afc9-faf7f665a9de resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15812025-02-13T05:16:46.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4982e994-4088-42ad-afc9-faf7f665a9de response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15822025-02-13T05:16:47.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c10db730-011e-4a69-9ad3-c03c3bb1e7e9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15832025-02-13T05:16:47.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c10db730-011e-4a69-9ad3-c03c3bb1e7e9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15842025-02-13T05:16:47.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c10db730-011e-4a69-9ad3-c03c3bb1e7e9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15852025-02-13T05:16:48.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 32dcb3fb-dd29-47f4-bb9c-9f5c68b000e1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15862025-02-13T05:16:48.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 32dcb3fb-dd29-47f4-bb9c-9f5c68b000e1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15872025-02-13T05:16:48.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2654 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 32dcb3fb-dd29-47f4-bb9c-9f5c68b000e1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15882025-02-13T05:16:50.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d5ffae90-12e9-4615-9bdb-fd67047b08d7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15892025-02-13T05:16:50.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d5ffae90-12e9-4615-9bdb-fd67047b08d7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15902025-02-13T05:16:50.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d5ffae90-12e9-4615-9bdb-fd67047b08d7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15912025-02-13T05:16:50.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 354 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 90273913-c647-4d35-97df-65a16dbb4f70 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
15922025-02-13T05:16:51.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 794ac1b8-9db2-4cde-80d8-50f1bfea731a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15932025-02-13T05:16:51.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 794ac1b8-9db2-4cde-80d8-50f1bfea731a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15942025-02-13T05:16:51.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1546 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 794ac1b8-9db2-4cde-80d8-50f1bfea731a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15952025-02-13T05:16:52.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 76443e86-c275-45b6-9c68-21587d9c3054 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15962025-02-13T05:16:52.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 76443e86-c275-45b6-9c68-21587d9c3054 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15972025-02-13T05:16:52.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 76443e86-c275-45b6-9c68-21587d9c3054 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15982025-02-13T05:16:53.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89476cb9-02ff-4049-9d0c-4c085defb767 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
15992025-02-13T05:16:53.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89476cb9-02ff-4049-9d0c-4c085defb767 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16002025-02-13T05:16:53.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2733 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89476cb9-02ff-4049-9d0c-4c085defb767 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16012025-02-13T05:16:54.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bda6b5ab-16c2-4be5-86e5-cf04de0735dc roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16022025-02-13T05:16:54.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bda6b5ab-16c2-4be5-86e5-cf04de0735dc resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16032025-02-13T05:16:54.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bda6b5ab-16c2-4be5-86e5-cf04de0735dc response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16042025-02-13T05:16:55.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 85aa0fbc-d574-494d-9b09-901892dc74f1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16052025-02-13T05:16:55.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 85aa0fbc-d574-494d-9b09-901892dc74f1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16062025-02-13T05:16:55.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1838 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 85aa0fbc-d574-494d-9b09-901892dc74f1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16072025-02-13T05:16:55.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 2f643b8a-9f20-44dc-84fe-100229217245 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
16082025-02-13T05:16:55.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 2f643b8a-9f20-44dc-84fe-100229217245 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
16092025-02-13T05:16:55.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1948 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 2f643b8a-9f20-44dc-84fe-100229217245 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
16102025-02-13T05:16:55.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = e66dca13-ffc0-436e-a131-169f8b4eb9c7 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
16112025-02-13T05:16:55.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = e66dca13-ffc0-436e-a131-169f8b4eb9c7 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
16122025-02-13T05:16:55.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2447 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = e66dca13-ffc0-436e-a131-169f8b4eb9c7 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
16132025-02-13T05:16:56.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 38e16f16-c9c0-4501-9a2b-08544a51fc4e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16142025-02-13T05:16:56.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 38e16f16-c9c0-4501-9a2b-08544a51fc4e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16152025-02-13T05:16:56.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1950 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 38e16f16-c9c0-4501-9a2b-08544a51fc4e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
16162025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
16172025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
16182025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
16192025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16202025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
16212025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16222025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
16232025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
16242025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16252025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16262025-02-13T05:16:56.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16272025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
16282025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
16292025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16302025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16312025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
16322025-02-13T05:16:56.241ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16332025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
16342025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16352025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16362025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
16372025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16382025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
16392025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
16402025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16412025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16422025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
16432025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16442025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
16452025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
16462025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16472025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
16482025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16492025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
16502025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
16512025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16522025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16532025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
16542025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16552025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16562025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
16572025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16582025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16592025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16602025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16612025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16622025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16632025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16642025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16652025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16662025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16672025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16682025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16692025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16702025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16712025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16722025-02-13T05:16:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16732025-02-13T05:16:56.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16742025-02-13T05:16:56.245ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.156469ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16752025-02-13T05:16:56.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 784368595 } })
16762025-02-13T05:16:56.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
16772025-02-13T05:16:56.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16782025-02-13T05:16:56.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16792025-02-13T05:16:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16802025-02-13T05:16:56.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 789692906 } })
16812025-02-13T05:16:56.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16822025-02-13T05:16:56.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
16832025-02-13T05:16:56.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16842025-02-13T05:16:56.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16852025-02-13T05:16:56.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16862025-02-13T05:16:56.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16872025-02-13T05:16:56.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16882025-02-13T05:16:56.257ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 796155930 } })
16892025-02-13T05:16:56.257ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
16902025-02-13T05:16:56.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16912025-02-13T05:16:56.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16922025-02-13T05:16:56.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16932025-02-13T05:16:56.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16942025-02-13T05:16:56.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16952025-02-13T05:16:56.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16962025-02-13T05:16:56.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16972025-02-13T05:16:56.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16982025-02-13T05:16:56.303ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16992025-02-13T05:16:56.303ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17002025-02-13T05:16:56.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17012025-02-13T05:16:56.303ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 62.509818ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
17022025-02-13T05:16:56.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17032025-02-13T05:16:56.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17042025-02-13T05:16:56.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17052025-02-13T05:16:56.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17062025-02-13T05:16:56.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.575944ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
17072025-02-13T05:16:56.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17082025-02-13T05:16:56.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17092025-02-13T05:16:56.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17102025-02-13T05:16:56.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17112025-02-13T05:16:56.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17122025-02-13T05:16:56.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17132025-02-13T05:16:56.312ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17142025-02-13T05:16:56.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17152025-02-13T05:16:56.312ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17162025-02-13T05:16:56.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17172025-02-13T05:16:56.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.674339ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17182025-02-13T05:16:56.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17192025-02-13T05:16:56.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17202025-02-13T05:16:56.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17212025-02-13T05:16:56.314ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17222025-02-13T05:16:56.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17232025-02-13T05:16:56.314ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17242025-02-13T05:16:56.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17252025-02-13T05:16:56.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17262025-02-13T05:16:56.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17272025-02-13T05:16:56.315ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17282025-02-13T05:16:56.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17292025-02-13T05:16:56.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17302025-02-13T05:16:56.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.181627ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
17312025-02-13T05:16:56.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17322025-02-13T05:16:56.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17332025-02-13T05:16:56.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17342025-02-13T05:16:56.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17352025-02-13T05:16:56.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17362025-02-13T05:16:56.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17372025-02-13T05:16:56.321ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17382025-02-13T05:16:56.322ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17392025-02-13T05:16:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17402025-02-13T05:16:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
17412025-02-13T05:16:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17422025-02-13T05:16:56.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17432025-02-13T05:16:56.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17442025-02-13T05:16:56.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17452025-02-13T05:16:56.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17462025-02-13T05:16:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17472025-02-13T05:16:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17482025-02-13T05:16:56.347ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
17492025-02-13T05:16:56.347ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.545371ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
17502025-02-13T05:16:56.357ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.295709ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17512025-02-13T05:16:56.360ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17522025-02-13T05:16:56.360ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17532025-02-13T05:16:56.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17542025-02-13T05:16:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17552025-02-13T05:16:56.364ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17562025-02-13T05:16:56.364ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17572025-02-13T05:16:56.364ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.093301ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17582025-02-13T05:16:56.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 126.857039ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17592025-02-13T05:16:56.367ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17602025-02-13T05:16:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17612025-02-13T05:16:56.369ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17622025-02-13T05:16:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17632025-02-13T05:16:56.372ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17642025-02-13T05:16:56.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17652025-02-13T05:16:56.374ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17662025-02-13T05:16:56.374ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 133.060455ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17672025-02-13T05:16:56.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17682025-02-13T05:16:56.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
17692025-02-13T05:16:56.377ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17702025-02-13T05:16:56.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17712025-02-13T05:16:56.379ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 138.585513ms iteration = 18 status = 0
17722025-02-13T05:16:56.386ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 145.647303ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
17732025-02-13T05:16:56.388ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
17742025-02-13T05:16:56.388ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17752025-02-13T05:16:56.388ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d37ab80-7477-40eb-ad54-e9bd0d1132c5", "content-length": "26", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
17762025-02-13T05:16:56.388ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17772025-02-13T05:16:56.390ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17782025-02-13T05:16:56.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17792025-02-13T05:16:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17802025-02-13T05:16:56.423ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
17812025-02-13T05:16:56.423ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 182.025668ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
17822025-02-13T05:16:56.461ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.160332ms iteration = 19 status = {"physical_disks_added":0}
17832025-02-13T05:16:56.467ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
17842025-02-13T05:16:56.467ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17852025-02-13T05:16:56.468ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "770b3146-64c2-4271-8856-a9b71362d3a9", "content-length": "26", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
17862025-02-13T05:16:56.468ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17872025-02-13T05:16:56.470ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17882025-02-13T05:16:56.470ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
17892025-02-13T05:16:56.470ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17902025-02-13T05:16:56.470ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84326c7b-33ca-47c9-8845-6ec61cd801e3", "content-length": "26", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
17912025-02-13T05:16:56.470ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17922025-02-13T05:16:56.473ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
17932025-02-13T05:16:56.498ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17942025-02-13T05:16:56.498ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17952025-02-13T05:16:56.499ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "58ef05bd-c87d-413d-b68a-3ea5d5e18367", "content-length": "372", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
17962025-02-13T05:16:56.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17972025-02-13T05:16:56.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17982025-02-13T05:16:56.521ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 280.631232ms iteration = 18 status = {}
17992025-02-13T05:16:56.558ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18002025-02-13T05:16:56.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18012025-02-13T05:16:56.559ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d00ee6fc-50a0-4c82-8c1a-eca91dc2e1d8", "content-length": "1", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
18022025-02-13T05:16:56.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18032025-02-13T05:16:56.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18042025-02-13T05:16:56.561ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18052025-02-13T05:16:56.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18062025-02-13T05:16:56.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18072025-02-13T05:16:56.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18082025-02-13T05:16:56.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18092025-02-13T05:16:56.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18102025-02-13T05:16:56.566ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 325.767896ms iteration = 18 status = null
18112025-02-13T05:16:56.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18122025-02-13T05:16:56.568ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18132025-02-13T05:16:56.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18142025-02-13T05:16:56.569ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
18152025-02-13T05:16:56.569ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18162025-02-13T05:16:56.569ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1edda2d4-90e5-4fc4-a255-da7b48b20823", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
18172025-02-13T05:16:56.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18182025-02-13T05:16:56.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18192025-02-13T05:16:56.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18202025-02-13T05:16:56.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18212025-02-13T05:16:56.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18222025-02-13T05:16:56.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18232025-02-13T05:16:56.580ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18242025-02-13T05:16:56.580ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18252025-02-13T05:16:56.581ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dc8355ec-5036-48c0-a4ee-e2af54fb5d4c", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
18262025-02-13T05:16:56.583ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 342.975456ms iteration = 18 status = {}
18272025-02-13T05:16:56.630ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18282025-02-13T05:16:56.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18292025-02-13T05:16:56.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18302025-02-13T05:16:56.665ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
18312025-02-13T05:16:56.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18322025-02-13T05:16:56.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18332025-02-13T05:16:56.676ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18342025-02-13T05:16:56.676ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "89b60aa3-c586-44bb-9ab9-5e0ff257d1c5", "content-length": "134", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
18352025-02-13T05:16:56.676ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18362025-02-13T05:16:56.676ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
18372025-02-13T05:16:56.677ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18382025-02-13T05:16:56.677ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18392025-02-13T05:16:56.677ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18402025-02-13T05:16:56.677ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18412025-02-13T05:16:56.677ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18422025-02-13T05:16:56.677ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18432025-02-13T05:16:56.677ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18442025-02-13T05:16:56.677ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18452025-02-13T05:16:56.677ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
18462025-02-13T05:16:56.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18472025-02-13T05:16:56.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18482025-02-13T05:16:56.679ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18492025-02-13T05:16:56.679ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ce42f90-7e87-444b-a39b-5f6881016599", "content-length": "2", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
18502025-02-13T05:16:56.679ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18512025-02-13T05:16:56.679ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "298d3ec3-80e5-45d5-96c0-06784282c0f1", "content-length": "52", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
18522025-02-13T05:16:56.679ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
18532025-02-13T05:16:56.679ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18542025-02-13T05:16:56.708ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b925fc29-2b53-4764-9cbf-4a657cd44903", "content-length": "691", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
18552025-02-13T05:16:56.708ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18562025-02-13T05:16:56.708ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18572025-02-13T05:16:56.708ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18582025-02-13T05:16:56.710ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 469.175106ms iteration = 18 status = {}
18592025-02-13T05:16:56.892ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e707eaaa-25aa-4b29-abfe-0bcd38b86621", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
18602025-02-13T05:16:56.892ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
18612025-02-13T05:16:56.892ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18622025-02-13T05:16:56.892ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "896d94c2-3866-4007-84ec-b98c17edaac9", "content-length": "682", "date": "Thu, 13 Feb 2025 05:16:56 GMT"} })
18632025-02-13T05:16:56.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18642025-02-13T05:16:56.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18652025-02-13T05:16:56.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18662025-02-13T05:16:56.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18672025-02-13T05:16:56.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18682025-02-13T05:16:56.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18692025-02-13T05:16:56.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18702025-02-13T05:16:56.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18712025-02-13T05:16:56.908ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 667.248969ms iteration = 18 status = {}
18722025-02-13T05:16:56.996ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
18732025-02-13T05:16:56.996ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
18742025-02-13T05:16:57.026ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
18752025-02-13T05:16:57.026ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:54481
18762025-02-13T05:16:57.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54481 req_id = 9271edb2-8753-49eb-8faa-1b784a36bc76 roles = RoleSet { roles: {} } uri = /metrics/producers
18772025-02-13T05:16:57.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54481 req_id = 9271edb2-8753-49eb-8faa-1b784a36bc76 resource = Database result = Ok(()) uri = /metrics/producers
18782025-02-13T05:16:57.091ZINFOnexus: assigned collector to new producer collector_id = 93aa177d-6d80-4ea9-988c-9de41b46fd8d file = nexus/src/app/oximeter.rs:76 producer_id = a8269f60-9104-4275-9edc-a31614d5c23e
18792025-02-13T05:16:57.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64819 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54481 req_id = 9271edb2-8753-49eb-8faa-1b784a36bc76 response_code = 201 uri = /metrics/producers
18802025-02-13T05:16:57.091ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9271edb2-8753-49eb-8faa-1b784a36bc76", "content-length": "41", "date": "Thu, 13 Feb 2025 05:16:57 GMT"} })
18812025-02-13T05:16:57.094ZDEBGnexus (producer-registration-task): registered with nexus successfully
18822025-02-13T05:16:57.094ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
18832025-02-13T05:16:57.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7424c206-9520-4d37-b8d3-d5e69a154505 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18842025-02-13T05:16:57.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7424c206-9520-4d37-b8d3-d5e69a154505 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18852025-02-13T05:16:57.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1797 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7424c206-9520-4d37-b8d3-d5e69a154505 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18862025-02-13T05:16:58.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 19e95530-2ce5-4e15-ae24-c57a1df0b2af roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18872025-02-13T05:16:58.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 19e95530-2ce5-4e15-ae24-c57a1df0b2af resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18882025-02-13T05:16:58.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1718 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 19e95530-2ce5-4e15-ae24-c57a1df0b2af response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18892025-02-13T05:16:59.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 62e57f48-1640-4720-840d-9b9ceb27f172 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18902025-02-13T05:16:59.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 62e57f48-1640-4720-840d-9b9ceb27f172 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18912025-02-13T05:16:59.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 62e57f48-1640-4720-840d-9b9ceb27f172 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18922025-02-13T05:17:00.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 419 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 33850063-6197-49b2-b2c8-d8e36d9d2ada response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
18932025-02-13T05:17:00.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f11cb921-7a9c-40de-9959-307744c54348 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18942025-02-13T05:17:00.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f11cb921-7a9c-40de-9959-307744c54348 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18952025-02-13T05:17:00.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f11cb921-7a9c-40de-9959-307744c54348 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18962025-02-13T05:17:01.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ed5fd73b-381d-47f0-94e6-faf53a120036 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18972025-02-13T05:17:01.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ed5fd73b-381d-47f0-94e6-faf53a120036 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18982025-02-13T05:17:01.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1705 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ed5fd73b-381d-47f0-94e6-faf53a120036 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
18992025-02-13T05:17:02.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 75186b4e-b2b2-4eb7-b36d-c804b55f0026 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19002025-02-13T05:17:02.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 75186b4e-b2b2-4eb7-b36d-c804b55f0026 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19012025-02-13T05:17:02.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 75186b4e-b2b2-4eb7-b36d-c804b55f0026 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19022025-02-13T05:17:03.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 98acb82e-d663-4ef1-ba94-641242952369 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19032025-02-13T05:17:03.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 98acb82e-d663-4ef1-ba94-641242952369 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19042025-02-13T05:17:03.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 98acb82e-d663-4ef1-ba94-641242952369 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19052025-02-13T05:17:04.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3d529350-fd9f-4118-a082-9fb624038637 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19062025-02-13T05:17:04.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3d529350-fd9f-4118-a082-9fb624038637 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19072025-02-13T05:17:04.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3d529350-fd9f-4118-a082-9fb624038637 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19082025-02-13T05:17:05.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d71cb8f6-f8c0-4645-b295-12e2edafd15f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19092025-02-13T05:17:05.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d71cb8f6-f8c0-4645-b295-12e2edafd15f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19102025-02-13T05:17:05.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1836 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d71cb8f6-f8c0-4645-b295-12e2edafd15f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19112025-02-13T05:17:06.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
19122025-02-13T05:17:06.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
19132025-02-13T05:17:06.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19142025-02-13T05:17:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19152025-02-13T05:17:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19162025-02-13T05:17:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19172025-02-13T05:17:06.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182025-02-13T05:17:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19192025-02-13T05:17:06.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19202025-02-13T05:17:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19212025-02-13T05:17:06.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19222025-02-13T05:17:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19232025-02-13T05:17:06.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19242025-02-13T05:17:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
19252025-02-13T05:17:06.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19262025-02-13T05:17:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19272025-02-13T05:17:06.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
19282025-02-13T05:17:06.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.647044ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
19292025-02-13T05:17:06.271ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19302025-02-13T05:17:06.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19312025-02-13T05:17:06.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.816855ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19322025-02-13T05:17:06.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = aeb94b3f-7aaa-4cfc-9db2-734479a9d5e9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19332025-02-13T05:17:06.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = aeb94b3f-7aaa-4cfc-9db2-734479a9d5e9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19342025-02-13T05:17:06.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = aeb94b3f-7aaa-4cfc-9db2-734479a9d5e9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19352025-02-13T05:17:07.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9d3abca1-73dc-4ead-87a8-92b84ee58148 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19362025-02-13T05:17:07.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9d3abca1-73dc-4ead-87a8-92b84ee58148 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19372025-02-13T05:17:07.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1906 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9d3abca1-73dc-4ead-87a8-92b84ee58148 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19382025-02-13T05:17:08.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a0c467c1-8b51-4d2f-83ce-b00dc6259896 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19392025-02-13T05:17:08.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a0c467c1-8b51-4d2f-83ce-b00dc6259896 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19402025-02-13T05:17:08.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a0c467c1-8b51-4d2f-83ce-b00dc6259896 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19412025-02-13T05:17:09.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21008bf6-5231-4d10-8d3b-f4a120d32e38 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19422025-02-13T05:17:09.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21008bf6-5231-4d10-8d3b-f4a120d32e38 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19432025-02-13T05:17:09.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21008bf6-5231-4d10-8d3b-f4a120d32e38 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19442025-02-13T05:17:10.163ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 666 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = b6466d48-c71a-4ac4-b1e3-83856d386751 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
19452025-02-13T05:17:10.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f23233d6-de8f-4baf-8fc8-c0af6f65516a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19462025-02-13T05:17:10.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f23233d6-de8f-4baf-8fc8-c0af6f65516a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19472025-02-13T05:17:10.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2189 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f23233d6-de8f-4baf-8fc8-c0af6f65516a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19482025-02-13T05:17:11.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5922583e-f16c-4f83-ab35-9d7adb6895e9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19492025-02-13T05:17:11.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5922583e-f16c-4f83-ab35-9d7adb6895e9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19502025-02-13T05:17:11.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2195 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5922583e-f16c-4f83-ab35-9d7adb6895e9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19512025-02-13T05:17:12.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7a2c3e8f-7683-40c0-b82a-df71d821e89a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19522025-02-13T05:17:12.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7a2c3e8f-7683-40c0-b82a-df71d821e89a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19532025-02-13T05:17:12.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1900 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7a2c3e8f-7683-40c0-b82a-df71d821e89a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19542025-02-13T05:17:13.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 29f2caa0-6cd1-467c-a76d-b04716e4ac19 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19552025-02-13T05:17:13.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 29f2caa0-6cd1-467c-a76d-b04716e4ac19 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19562025-02-13T05:17:13.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 29f2caa0-6cd1-467c-a76d-b04716e4ac19 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19572025-02-13T05:17:14.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b37aa314-0259-4f98-9d23-c24f3f1626be roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19582025-02-13T05:17:14.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b37aa314-0259-4f98-9d23-c24f3f1626be resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19592025-02-13T05:17:14.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b37aa314-0259-4f98-9d23-c24f3f1626be response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19602025-02-13T05:17:15.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a6a5e1c6-7dae-4a57-ad5a-7361632a4398 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19612025-02-13T05:17:15.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a6a5e1c6-7dae-4a57-ad5a-7361632a4398 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19622025-02-13T05:17:15.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a6a5e1c6-7dae-4a57-ad5a-7361632a4398 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19632025-02-13T05:17:16.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
19642025-02-13T05:17:16.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
19652025-02-13T05:17:16.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19662025-02-13T05:17:16.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19672025-02-13T05:17:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19682025-02-13T05:17:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19692025-02-13T05:17:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702025-02-13T05:17:16.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19712025-02-13T05:17:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19722025-02-13T05:17:16.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.52362ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19732025-02-13T05:17:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19742025-02-13T05:17:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19752025-02-13T05:17:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19762025-02-13T05:17:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19772025-02-13T05:17:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19782025-02-13T05:17:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19792025-02-13T05:17:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
19802025-02-13T05:17:16.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19812025-02-13T05:17:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19822025-02-13T05:17:16.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
19832025-02-13T05:17:16.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.357357ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
19842025-02-13T05:17:16.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0c11bc2e-6eea-4863-8448-9bf5c22ef5aa roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19852025-02-13T05:17:16.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0c11bc2e-6eea-4863-8448-9bf5c22ef5aa resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19862025-02-13T05:17:16.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0c11bc2e-6eea-4863-8448-9bf5c22ef5aa response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19872025-02-13T05:17:17.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 154e34bd-242c-4478-bcb9-e86c1f6f723c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19882025-02-13T05:17:17.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 154e34bd-242c-4478-bcb9-e86c1f6f723c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19892025-02-13T05:17:17.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 154e34bd-242c-4478-bcb9-e86c1f6f723c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19902025-02-13T05:17:18.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4368328f-d6e0-4663-978f-281f760096d5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19912025-02-13T05:17:18.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4368328f-d6e0-4663-978f-281f760096d5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19922025-02-13T05:17:18.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4368328f-d6e0-4663-978f-281f760096d5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19932025-02-13T05:17:19.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3fa2762c-cf29-49ca-b8a9-9c1c61a66575 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19942025-02-13T05:17:19.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3fa2762c-cf29-49ca-b8a9-9c1c61a66575 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19952025-02-13T05:17:19.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1799 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3fa2762c-cf29-49ca-b8a9-9c1c61a66575 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19962025-02-13T05:17:20.163ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 407 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 93efe022-24f4-4c11-a47b-673f91c502e4 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
19972025-02-13T05:17:20.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d31b7757-e616-4a44-a1f7-c318ad9536d9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19982025-02-13T05:17:20.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d31b7757-e616-4a44-a1f7-c318ad9536d9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
19992025-02-13T05:17:20.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2808 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d31b7757-e616-4a44-a1f7-c318ad9536d9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20002025-02-13T05:17:21.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ccc64191-fd9d-45a0-bed5-6e8228b9110b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20012025-02-13T05:17:21.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ccc64191-fd9d-45a0-bed5-6e8228b9110b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20022025-02-13T05:17:21.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ccc64191-fd9d-45a0-bed5-6e8228b9110b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20032025-02-13T05:17:22.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a19c7282-9f28-4726-8234-efc3a4a95dc3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20042025-02-13T05:17:22.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a19c7282-9f28-4726-8234-efc3a4a95dc3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20052025-02-13T05:17:22.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1997 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a19c7282-9f28-4726-8234-efc3a4a95dc3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20062025-02-13T05:17:23.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a7c4354f-bcd9-4ccf-98d8-406651b6e3dd roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20072025-02-13T05:17:23.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a7c4354f-bcd9-4ccf-98d8-406651b6e3dd resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20082025-02-13T05:17:23.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1988 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a7c4354f-bcd9-4ccf-98d8-406651b6e3dd response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20092025-02-13T05:17:24.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f109dd42-ee2d-4613-bb4d-df53ebf87e49 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20102025-02-13T05:17:24.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f109dd42-ee2d-4613-bb4d-df53ebf87e49 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20112025-02-13T05:17:24.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f109dd42-ee2d-4613-bb4d-df53ebf87e49 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20122025-02-13T05:17:25.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 4acb8301-0203-49d2-809e-c19eeae9a8c8 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
20132025-02-13T05:17:25.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 4acb8301-0203-49d2-809e-c19eeae9a8c8 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
20142025-02-13T05:17:25.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2481 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 4acb8301-0203-49d2-809e-c19eeae9a8c8 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
20152025-02-13T05:17:25.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 48ff2fa0-c0e5-4f35-9bc2-6e6dea62a577 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
20162025-02-13T05:17:25.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 48ff2fa0-c0e5-4f35-9bc2-6e6dea62a577 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
20172025-02-13T05:17:25.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1886 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 48ff2fa0-c0e5-4f35-9bc2-6e6dea62a577 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
20182025-02-13T05:17:25.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c1148ff5-fe67-48fb-b91d-461d7c858a0d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20192025-02-13T05:17:25.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c1148ff5-fe67-48fb-b91d-461d7c858a0d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20202025-02-13T05:17:25.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c1148ff5-fe67-48fb-b91d-461d7c858a0d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
20212025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
20222025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
20232025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
20242025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
20252025-02-13T05:17:26.241ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = e132683f-3ab0-4513-890f-86716ec9a9cf
20262025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.011\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf"}
20272025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20282025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
20292025-02-13T05:17:26.241ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-13 05:07:26.241513462 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
20302025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
20312025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
20322025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
20332025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
20342025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20352025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
20362025-02-13T05:17:26.241ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
20372025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
20382025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20392025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
20402025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20412025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
20422025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
20432025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20442025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
20452025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
20462025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
20472025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
20482025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
20492025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20502025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
20512025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
20522025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20532025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
20542025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20552025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
20562025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
20572025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20582025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20592025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
20602025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
20612025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20622025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20632025-02-13T05:17:26.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
20642025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20652025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
20662025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20672025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
20682025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20692025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
20702025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
20712025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20722025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20732025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
20742025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20752025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
20762025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
20772025-02-13T05:17:26.242ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20782025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20792025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20802025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
20812025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
20822025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20832025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
20842025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20852025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
20862025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20872025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
20882025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20892025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20902025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
20912025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20922025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20932025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
20942025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20952025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20962025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
20972025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20982025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20992025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21002025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21012025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21022025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21032025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21042025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21052025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21062025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21072025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21082025-02-13T05:17:26.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec95727a-7af6-45d1-9962-81bf544db84b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 781498603 } })
21092025-02-13T05:17:26.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9f4eb8b3-c464-433c-b912-c7432c124258.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cc24f910-ffb5-4de8-b7e1-4b9d4d15a7cd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 781501743 } })
21102025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21112025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21122025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21132025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21142025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21152025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21162025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21172025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21182025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
21192025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21202025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21212025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21222025-02-13T05:17:26.242ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
21232025-02-13T05:17:26.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21242025-02-13T05:17:26.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.370549ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
21252025-02-13T05:17:26.243ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
21262025-02-13T05:17:26.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.545404ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
21272025-02-13T05:17:26.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21282025-02-13T05:17:26.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21292025-02-13T05:17:26.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21302025-02-13T05:17:26.244ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21312025-02-13T05:17:26.244ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-13 05:07:26.241513462 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
21322025-02-13T05:17:26.244ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.264843ms iteration = 10 status = {"expiration":"2025-02-13T05:07:26.241513462Z","pruned":[]}
21332025-02-13T05:17:26.245ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21342025-02-13T05:17:26.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21352025-02-13T05:17:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21362025-02-13T05:17:26.246ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.429506ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
21372025-02-13T05:17:26.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21382025-02-13T05:17:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21392025-02-13T05:17:26.247ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21402025-02-13T05:17:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21412025-02-13T05:17:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
21422025-02-13T05:17:26.247ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21432025-02-13T05:17:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21442025-02-13T05:17:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21452025-02-13T05:17:26.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21462025-02-13T05:17:26.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21472025-02-13T05:17:26.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21482025-02-13T05:17:26.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21492025-02-13T05:17:26.252ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21502025-02-13T05:17:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21512025-02-13T05:17:26.255ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21522025-02-13T05:17:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21532025-02-13T05:17:26.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.900985ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
21542025-02-13T05:17:26.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21552025-02-13T05:17:26.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21562025-02-13T05:17:26.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21572025-02-13T05:17:26.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21582025-02-13T05:17:26.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21592025-02-13T05:17:26.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21602025-02-13T05:17:26.260ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21612025-02-13T05:17:26.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21622025-02-13T05:17:26.260ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21632025-02-13T05:17:26.260ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 799736362 } })
21642025-02-13T05:17:26.261ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 800047281 } })
21652025-02-13T05:17:26.261ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
21662025-02-13T05:17:26.261ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
21672025-02-13T05:17:26.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21682025-02-13T05:17:26.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21692025-02-13T05:17:26.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21702025-02-13T05:17:26.263ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21712025-02-13T05:17:26.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21722025-02-13T05:17:26.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21732025-02-13T05:17:26.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21742025-02-13T05:17:26.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21752025-02-13T05:17:26.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21762025-02-13T05:17:26.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21772025-02-13T05:17:26.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21782025-02-13T05:17:26.268ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.974978ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
21792025-02-13T05:17:26.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21802025-02-13T05:17:26.270ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21812025-02-13T05:17:26.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21822025-02-13T05:17:26.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21832025-02-13T05:17:26.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21842025-02-13T05:17:26.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21852025-02-13T05:17:26.282ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21862025-02-13T05:17:26.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21872025-02-13T05:17:26.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21882025-02-13T05:17:26.285ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21892025-02-13T05:17:26.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21902025-02-13T05:17:26.285ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21912025-02-13T05:17:26.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21922025-02-13T05:17:26.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21932025-02-13T05:17:26.287ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21942025-02-13T05:17:26.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21952025-02-13T05:17:26.287ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21962025-02-13T05:17:26.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21972025-02-13T05:17:26.290ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21982025-02-13T05:17:26.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21992025-02-13T05:17:26.294ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 832090952 } })
22002025-02-13T05:17:26.294ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
22012025-02-13T05:17:26.296ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22022025-02-13T05:17:26.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22032025-02-13T05:17:26.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22042025-02-13T05:17:26.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22052025-02-13T05:17:26.300ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22062025-02-13T05:17:26.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22072025-02-13T05:17:26.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22082025-02-13T05:17:26.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22092025-02-13T05:17:26.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22102025-02-13T05:17:26.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22112025-02-13T05:17:26.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22122025-02-13T05:17:26.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22132025-02-13T05:17:26.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22142025-02-13T05:17:26.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22152025-02-13T05:17:26.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22162025-02-13T05:17:26.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22172025-02-13T05:17:26.312ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22182025-02-13T05:17:26.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22192025-02-13T05:17:26.318ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22202025-02-13T05:17:26.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22212025-02-13T05:17:26.319ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
22222025-02-13T05:17:26.319ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
22232025-02-13T05:17:26.319ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 78.238086ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
22242025-02-13T05:17:26.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22252025-02-13T05:17:26.321ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22262025-02-13T05:17:26.321ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
22272025-02-13T05:17:26.321ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22282025-02-13T05:17:26.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22292025-02-13T05:17:26.323ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22302025-02-13T05:17:26.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22312025-02-13T05:17:26.326ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 84.599387ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
22322025-02-13T05:17:26.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
22332025-02-13T05:17:26.326ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22342025-02-13T05:17:26.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.141732ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
22352025-02-13T05:17:26.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22362025-02-13T05:17:26.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22372025-02-13T05:17:26.329ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22382025-02-13T05:17:26.330ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22392025-02-13T05:17:26.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22402025-02-13T05:17:26.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22412025-02-13T05:17:26.333ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22422025-02-13T05:17:26.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22432025-02-13T05:17:26.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
22442025-02-13T05:17:26.333ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22452025-02-13T05:17:26.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22462025-02-13T05:17:26.340ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22472025-02-13T05:17:26.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22482025-02-13T05:17:26.342ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 101.184098ms iteration = 5 status = {"nsuccess":5}
22492025-02-13T05:17:26.346ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22502025-02-13T05:17:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22512025-02-13T05:17:26.349ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22522025-02-13T05:17:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22532025-02-13T05:17:26.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22542025-02-13T05:17:26.351ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 109.968158ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22552025-02-13T05:17:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22562025-02-13T05:17:26.359ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
22572025-02-13T05:17:26.359ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
22582025-02-13T05:17:26.359ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 118.12585ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
22592025-02-13T05:17:26.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
22602025-02-13T05:17:26.363ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
22612025-02-13T05:17:26.363ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.116335ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
22622025-02-13T05:17:26.372ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22632025-02-13T05:17:26.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22642025-02-13T05:17:26.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22652025-02-13T05:17:26.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22662025-02-13T05:17:26.377ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
22672025-02-13T05:17:26.377ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
22682025-02-13T05:17:26.377ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
22692025-02-13T05:17:26.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22702025-02-13T05:17:26.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22712025-02-13T05:17:26.378ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22722025-02-13T05:17:26.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
22732025-02-13T05:17:26.382ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22742025-02-13T05:17:26.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22752025-02-13T05:17:26.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22762025-02-13T05:17:26.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22772025-02-13T05:17:26.386ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22782025-02-13T05:17:26.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22792025-02-13T05:17:26.389ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.829505ms iteration = 19 status = 0
22802025-02-13T05:17:26.391ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
22812025-02-13T05:17:26.391ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 150.032538ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
22822025-02-13T05:17:26.401ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.313662ms iteration = 20 status = {"physical_disks_added":0}
22832025-02-13T05:17:26.401ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
22842025-02-13T05:17:26.403ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22852025-02-13T05:17:26.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22862025-02-13T05:17:26.404ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22872025-02-13T05:17:26.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22882025-02-13T05:17:26.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 165.913499ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
22892025-02-13T05:17:26.407ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22902025-02-13T05:17:26.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 166.024343ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22912025-02-13T05:17:26.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 168.998478ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22922025-02-13T05:17:26.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22932025-02-13T05:17:26.410ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22942025-02-13T05:17:26.410ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22952025-02-13T05:17:26.410ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22962025-02-13T05:17:26.410ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22972025-02-13T05:17:26.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22982025-02-13T05:17:26.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22992025-02-13T05:17:26.424ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23002025-02-13T05:17:26.424ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23012025-02-13T05:17:26.424ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23022025-02-13T05:17:26.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23032025-02-13T05:17:26.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23042025-02-13T05:17:26.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23052025-02-13T05:17:26.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23062025-02-13T05:17:26.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23072025-02-13T05:17:26.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23082025-02-13T05:17:26.456ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
23092025-02-13T05:17:26.456ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 215.197161ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
23102025-02-13T05:17:26.458ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23112025-02-13T05:17:26.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23122025-02-13T05:17:26.474ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23132025-02-13T05:17:26.475ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23142025-02-13T05:17:26.475ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 233.174093ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23152025-02-13T05:17:26.475ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23162025-02-13T05:17:26.475ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23172025-02-13T05:17:26.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23182025-02-13T05:17:26.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23192025-02-13T05:17:26.477ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-13T05:08:23.439194Z, time_modified: 2025-02-13T05:08:23.439194Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }) }
23202025-02-13T05:17:26.477ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 235.824998ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]}},"default_endpoint":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
23212025-02-13T05:17:26.478ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23222025-02-13T05:17:26.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23232025-02-13T05:17:26.483ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23242025-02-13T05:17:26.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23252025-02-13T05:17:26.490ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
23262025-02-13T05:17:26.490ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23272025-02-13T05:17:26.491ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e76e7bba-91ea-44b6-980d-c7aa21c641b2", "content-length": "26", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
23282025-02-13T05:17:26.491ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23292025-02-13T05:17:26.494ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23302025-02-13T05:17:26.503ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
23312025-02-13T05:17:26.503ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23322025-02-13T05:17:26.504ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c598378-5b3e-4100-8e90-37ad1bf8305e", "content-length": "26", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
23332025-02-13T05:17:26.504ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23342025-02-13T05:17:26.508ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
23352025-02-13T05:17:26.511ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
23362025-02-13T05:17:26.511ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 0 version = 2
23372025-02-13T05:17:26.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23382025-02-13T05:17:26.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23392025-02-13T05:17:26.513ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
23402025-02-13T05:17:26.513ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23412025-02-13T05:17:26.513ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "717c9322-3019-4d7f-a593-0410da6eba93", "content-length": "26", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
23422025-02-13T05:17:26.513ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23432025-02-13T05:17:26.526ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
23442025-02-13T05:17:26.526ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 285.052228ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
23452025-02-13T05:17:26.526ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23462025-02-13T05:17:26.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23472025-02-13T05:17:26.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23482025-02-13T05:17:26.641ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23492025-02-13T05:17:26.645ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
23502025-02-13T05:17:26.645ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0c3b327d-8c68-4790-92a0-7a7a79e03c38", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23512025-02-13T05:17:26.645ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23522025-02-13T05:17:26.646ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "69233245-c2cf-4258-b346-67ab8addf065", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23532025-02-13T05:17:26.647ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23542025-02-13T05:17:26.648ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23552025-02-13T05:17:26.648ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 406.775591ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23562025-02-13T05:17:26.666ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 424.426273ms iteration = 19 status = {}
23572025-02-13T05:17:26.693ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23582025-02-13T05:17:26.694ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b871b67a-b9c1-48ff-ad50-749719e50727", "content-length": "1", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
23592025-02-13T05:17:26.695ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23602025-02-13T05:17:26.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23612025-02-13T05:17:26.728ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23622025-02-13T05:17:26.728ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23632025-02-13T05:17:26.728ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "83e2b12d-a833-4cc1-a69c-c631ad44b1fa", "content-length": "372", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
23642025-02-13T05:17:26.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23652025-02-13T05:17:26.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23662025-02-13T05:17:26.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23672025-02-13T05:17:26.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23682025-02-13T05:17:26.731ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
23692025-02-13T05:17:26.731ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23702025-02-13T05:17:26.731ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-13 05:08:26.528706 UTC dns_group = internal generation = 1
23712025-02-13T05:17:26.731ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 490.308727ms iteration = 10 status = {"generation":1}
23722025-02-13T05:17:26.732ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 490.472112ms iteration = 19 status = null
23732025-02-13T05:17:26.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23742025-02-13T05:17:26.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23752025-02-13T05:17:26.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23762025-02-13T05:17:26.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23772025-02-13T05:17:26.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23782025-02-13T05:17:26.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23792025-02-13T05:17:26.737ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23802025-02-13T05:17:26.738ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 1 version = 2
23812025-02-13T05:17:26.738ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
23822025-02-13T05:17:26.738ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-13 05:08:27.963644 UTC dns_group = external generation = 2
23832025-02-13T05:17:26.738ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 496.145784ms iteration = 10 status = {"generation":2}
23842025-02-13T05:17:26.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23852025-02-13T05:17:26.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23862025-02-13T05:17:26.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23872025-02-13T05:17:26.744ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
23882025-02-13T05:17:26.744ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23892025-02-13T05:17:26.744ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "828cdcff-160c-46f9-b37b-750a4785a6e7", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
23902025-02-13T05:17:26.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23912025-02-13T05:17:26.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23922025-02-13T05:17:26.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23932025-02-13T05:17:26.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23942025-02-13T05:17:26.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23952025-02-13T05:17:26.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23962025-02-13T05:17:26.753ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23972025-02-13T05:17:26.753ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23982025-02-13T05:17:26.753ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e583128e-898f-4c7c-95c5-64b7f75d5ac3", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
23992025-02-13T05:17:26.755ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 513.574469ms iteration = 19 status = {}
24002025-02-13T05:17:26.764ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24012025-02-13T05:17:26.764ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2d84bff7-af5e-4637-b528-cb17d924d8d0", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24022025-02-13T05:17:26.764ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24032025-02-13T05:17:26.766ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "99c077db-6338-4603-9aba-778e1fe5b44f", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24042025-02-13T05:17:26.766ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24052025-02-13T05:17:26.768ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e9e9beff-d933-458b-b768-f7e41ba0fe32", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24062025-02-13T05:17:26.768ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24072025-02-13T05:17:26.770ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
24082025-02-13T05:17:26.770ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 528.940046ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24092025-02-13T05:17:26.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b5e53ad5-88f9-4646-a8f3-0021a621f423 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24102025-02-13T05:17:26.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b5e53ad5-88f9-4646-a8f3-0021a621f423 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24112025-02-13T05:17:26.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3054 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b5e53ad5-88f9-4646-a8f3-0021a621f423 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24122025-02-13T05:17:26.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24132025-02-13T05:17:26.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24142025-02-13T05:17:26.819ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
24152025-02-13T05:17:26.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24162025-02-13T05:17:26.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24172025-02-13T05:17:26.828ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24182025-02-13T05:17:26.829ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bafdb928-dee0-4957-96bc-2d5343446adc", "content-length": "134", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
24192025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24202025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
24212025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24222025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24232025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24242025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24252025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24262025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24272025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24282025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24292025-02-13T05:17:26.829ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
24302025-02-13T05:17:26.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24312025-02-13T05:17:26.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24322025-02-13T05:17:26.832ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24332025-02-13T05:17:26.832ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4f4e945-54e7-4dc7-a311-01e54c135510", "content-length": "2", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
24342025-02-13T05:17:26.832ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24352025-02-13T05:17:26.832ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "291ff8ba-d425-452f-b1cb-fbc6a2b3deab", "content-length": "52", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
24362025-02-13T05:17:26.832ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
24372025-02-13T05:17:26.832ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24382025-02-13T05:17:26.844ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24392025-02-13T05:17:26.918ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "46c61214-3b86-4ba1-a7d7-7c73682c84da", "content-length": "691", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
24402025-02-13T05:17:26.918ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
24412025-02-13T05:17:26.918ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
24422025-02-13T05:17:26.918ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
24432025-02-13T05:17:26.920ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 678.14677ms iteration = 19 status = {}
24442025-02-13T05:17:27.023ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8135ea2d-817e-4c61-8b90-01b1064817bd", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
24452025-02-13T05:17:27.023ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
24462025-02-13T05:17:27.023ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24472025-02-13T05:17:27.028ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc2298ce-af7a-490c-b058-a88486de058e", "content-length": "682", "date": "Thu, 13 Feb 2025 05:17:26 GMT"} })
24482025-02-13T05:17:27.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24492025-02-13T05:17:27.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24502025-02-13T05:17:27.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24512025-02-13T05:17:27.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24522025-02-13T05:17:27.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24532025-02-13T05:17:27.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24542025-02-13T05:17:27.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24552025-02-13T05:17:27.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24562025-02-13T05:17:27.045ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 804.410541ms iteration = 19 status = {}
24572025-02-13T05:17:27.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1b3c17b0-8137-49e6-aa50-40ed5528251f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24582025-02-13T05:17:27.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1b3c17b0-8137-49e6-aa50-40ed5528251f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24592025-02-13T05:17:27.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1787 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1b3c17b0-8137-49e6-aa50-40ed5528251f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24602025-02-13T05:17:28.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 926a3871-2c74-462e-8542-eb4e5999fb43 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24612025-02-13T05:17:28.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 926a3871-2c74-462e-8542-eb4e5999fb43 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24622025-02-13T05:17:28.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 926a3871-2c74-462e-8542-eb4e5999fb43 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24632025-02-13T05:17:29.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ee99e293-3e8e-4f2e-bf90-d81c4594ae0c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24642025-02-13T05:17:29.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ee99e293-3e8e-4f2e-bf90-d81c4594ae0c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24652025-02-13T05:17:29.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2453 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ee99e293-3e8e-4f2e-bf90-d81c4594ae0c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24662025-02-13T05:17:30.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 370 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 4036e313-e302-4d7d-8851-8c8c632b65f2 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
24672025-02-13T05:17:30.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9ab6df30-35eb-44ee-8d6c-57e5cd647af6 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24682025-02-13T05:17:30.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9ab6df30-35eb-44ee-8d6c-57e5cd647af6 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24692025-02-13T05:17:30.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9ab6df30-35eb-44ee-8d6c-57e5cd647af6 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24702025-02-13T05:17:32.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0d1ec994-8f46-4ac4-bab9-eed90389d599 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24712025-02-13T05:17:32.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0d1ec994-8f46-4ac4-bab9-eed90389d599 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24722025-02-13T05:17:32.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0d1ec994-8f46-4ac4-bab9-eed90389d599 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24732025-02-13T05:17:33.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5ddd5520-6e40-41fb-ab59-7d5b0e19d443 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24742025-02-13T05:17:33.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5ddd5520-6e40-41fb-ab59-7d5b0e19d443 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24752025-02-13T05:17:33.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5ddd5520-6e40-41fb-ab59-7d5b0e19d443 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24762025-02-13T05:17:34.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 77697d99-fcbf-4ffc-9d31-4ad9f8f6cb59 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24772025-02-13T05:17:34.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 77697d99-fcbf-4ffc-9d31-4ad9f8f6cb59 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24782025-02-13T05:17:34.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 77697d99-fcbf-4ffc-9d31-4ad9f8f6cb59 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24792025-02-13T05:17:35.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 57ac8ef1-e015-4cae-be26-ea9213044345 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24802025-02-13T05:17:35.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 57ac8ef1-e015-4cae-be26-ea9213044345 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24812025-02-13T05:17:35.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2378 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 57ac8ef1-e015-4cae-be26-ea9213044345 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24822025-02-13T05:17:36.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7f80fcd5-7893-446d-b857-1093dfb5f675 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24832025-02-13T05:17:36.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7f80fcd5-7893-446d-b857-1093dfb5f675 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24842025-02-13T05:17:36.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1812 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7f80fcd5-7893-446d-b857-1093dfb5f675 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
24852025-02-13T05:17:36.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
24862025-02-13T05:17:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
24872025-02-13T05:17:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24882025-02-13T05:17:36.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24892025-02-13T05:17:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24902025-02-13T05:17:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24912025-02-13T05:17:36.269ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24922025-02-13T05:17:36.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24932025-02-13T05:17:36.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24942025-02-13T05:17:36.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24952025-02-13T05:17:36.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24962025-02-13T05:17:36.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24972025-02-13T05:17:36.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24982025-02-13T05:17:36.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24992025-02-13T05:17:36.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.327555ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25002025-02-13T05:17:36.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25012025-02-13T05:17:36.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
25022025-02-13T05:17:36.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25032025-02-13T05:17:36.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25042025-02-13T05:17:36.329ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
25052025-02-13T05:17:36.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.567749ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
25062025-02-13T05:17:37.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1ae9d614-7234-40a9-8132-f8bc915d50df roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25072025-02-13T05:17:37.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1ae9d614-7234-40a9-8132-f8bc915d50df resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25082025-02-13T05:17:37.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1ae9d614-7234-40a9-8132-f8bc915d50df response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25092025-02-13T05:17:38.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 355fc653-ae57-4300-a7fa-b1ce816a6e5f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25102025-02-13T05:17:38.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 355fc653-ae57-4300-a7fa-b1ce816a6e5f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25112025-02-13T05:17:38.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1671 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 355fc653-ae57-4300-a7fa-b1ce816a6e5f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25122025-02-13T05:17:39.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 20d55f48-c5e0-47f7-ae61-7b4408f73c23 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25132025-02-13T05:17:39.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 20d55f48-c5e0-47f7-ae61-7b4408f73c23 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25142025-02-13T05:17:39.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 20d55f48-c5e0-47f7-ae61-7b4408f73c23 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25152025-02-13T05:17:40.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 725bdde2-7c9c-4659-a986-e17c3cd39230 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
25162025-02-13T05:17:40.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 725bdde2-7c9c-4659-a986-e17c3cd39230 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
25172025-02-13T05:17:40.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 725bdde2-7c9c-4659-a986-e17c3cd39230 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
25182025-02-13T05:17:40.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 830518a9-6738-4379-a471-2fd54defefab roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
25192025-02-13T05:17:40.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 830518a9-6738-4379-a471-2fd54defefab resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
25202025-02-13T05:17:40.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 830518a9-6738-4379-a471-2fd54defefab response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
25212025-02-13T05:17:40.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 367 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 954f9a37-91e3-46e3-a695-653eca1c15ad response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
25222025-02-13T05:17:40.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4b34f292-edad-4834-9b50-4d148779e17d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25232025-02-13T05:17:40.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4b34f292-edad-4834-9b50-4d148779e17d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25242025-02-13T05:17:40.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1855 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4b34f292-edad-4834-9b50-4d148779e17d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25252025-02-13T05:17:41.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 06bcdee3-36cb-496b-84e9-eccf4aadbf21 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25262025-02-13T05:17:41.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 06bcdee3-36cb-496b-84e9-eccf4aadbf21 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25272025-02-13T05:17:41.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1986 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 06bcdee3-36cb-496b-84e9-eccf4aadbf21 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25282025-02-13T05:17:42.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 01b25c8d-71d9-49ee-8814-b92534de0d17 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25292025-02-13T05:17:42.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 01b25c8d-71d9-49ee-8814-b92534de0d17 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25302025-02-13T05:17:42.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2545 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 01b25c8d-71d9-49ee-8814-b92534de0d17 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25312025-02-13T05:17:43.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6d1a389d-30d2-4b49-a30d-ffd396893a48 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25322025-02-13T05:17:43.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6d1a389d-30d2-4b49-a30d-ffd396893a48 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25332025-02-13T05:17:43.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1798 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6d1a389d-30d2-4b49-a30d-ffd396893a48 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25342025-02-13T05:17:44.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e170220d-1d1b-4646-aeb1-fbee7777b9ae roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25352025-02-13T05:17:44.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e170220d-1d1b-4646-aeb1-fbee7777b9ae resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25362025-02-13T05:17:44.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e170220d-1d1b-4646-aeb1-fbee7777b9ae response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25372025-02-13T05:17:45.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 10770e6e-075e-47b2-a888-a4c24156822e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25382025-02-13T05:17:45.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 10770e6e-075e-47b2-a888-a4c24156822e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25392025-02-13T05:17:45.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 10770e6e-075e-47b2-a888-a4c24156822e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25402025-02-13T05:17:46.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
25412025-02-13T05:17:46.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
25422025-02-13T05:17:46.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25432025-02-13T05:17:46.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25442025-02-13T05:17:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25452025-02-13T05:17:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25462025-02-13T05:17:46.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25472025-02-13T05:17:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25482025-02-13T05:17:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25492025-02-13T05:17:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25502025-02-13T05:17:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25512025-02-13T05:17:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25522025-02-13T05:17:46.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25532025-02-13T05:17:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
25542025-02-13T05:17:46.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25552025-02-13T05:17:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25562025-02-13T05:17:46.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
25572025-02-13T05:17:46.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.304585ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
25582025-02-13T05:17:46.271ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25592025-02-13T05:17:46.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25602025-02-13T05:17:46.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.369302ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25612025-02-13T05:17:46.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 56168db8-ed46-4bc3-856a-b0d16807604a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25622025-02-13T05:17:46.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 56168db8-ed46-4bc3-856a-b0d16807604a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25632025-02-13T05:17:46.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1660 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 56168db8-ed46-4bc3-856a-b0d16807604a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25642025-02-13T05:17:47.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 58f88cd0-6415-4d0d-bc52-b9a2a8c6f33c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25652025-02-13T05:17:47.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 58f88cd0-6415-4d0d-bc52-b9a2a8c6f33c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25662025-02-13T05:17:47.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 58f88cd0-6415-4d0d-bc52-b9a2a8c6f33c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25672025-02-13T05:17:48.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e2425d0f-9ced-48a1-a4be-bc76e9be5bd0 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25682025-02-13T05:17:48.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e2425d0f-9ced-48a1-a4be-bc76e9be5bd0 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25692025-02-13T05:17:48.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2190 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e2425d0f-9ced-48a1-a4be-bc76e9be5bd0 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25702025-02-13T05:17:49.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8615e8fd-6de4-4bc6-8a2f-8be6f59d960d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25712025-02-13T05:17:49.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8615e8fd-6de4-4bc6-8a2f-8be6f59d960d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25722025-02-13T05:17:49.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8615e8fd-6de4-4bc6-8a2f-8be6f59d960d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25732025-02-13T05:17:50.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 398 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 4578f01f-b422-4240-8b65-b1e665b395b3 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
25742025-02-13T05:17:50.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5bf25e4a-aec0-4cf3-9640-ffab7a18cbba roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25752025-02-13T05:17:50.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5bf25e4a-aec0-4cf3-9640-ffab7a18cbba resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25762025-02-13T05:17:50.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1792 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5bf25e4a-aec0-4cf3-9640-ffab7a18cbba response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25772025-02-13T05:17:51.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6244a8b6-32bc-4356-8c8c-b5d67aa16439 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25782025-02-13T05:17:51.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6244a8b6-32bc-4356-8c8c-b5d67aa16439 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25792025-02-13T05:17:51.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6244a8b6-32bc-4356-8c8c-b5d67aa16439 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25802025-02-13T05:17:52.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 63a5e5d7-7c1d-4b9d-97d1-b28cd0485dfb roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25812025-02-13T05:17:52.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 63a5e5d7-7c1d-4b9d-97d1-b28cd0485dfb resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25822025-02-13T05:17:52.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 63a5e5d7-7c1d-4b9d-97d1-b28cd0485dfb response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25832025-02-13T05:17:53.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b11e7ba8-c0ed-4e45-9785-246315e12951 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25842025-02-13T05:17:53.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b11e7ba8-c0ed-4e45-9785-246315e12951 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25852025-02-13T05:17:53.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b11e7ba8-c0ed-4e45-9785-246315e12951 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25862025-02-13T05:17:54.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9ca76066-857f-41ab-b781-7ff3ca980dd7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25872025-02-13T05:17:54.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9ca76066-857f-41ab-b781-7ff3ca980dd7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25882025-02-13T05:17:54.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9ca76066-857f-41ab-b781-7ff3ca980dd7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25892025-02-13T05:17:55.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1104faf9-ba44-4473-b59a-2d4b1d692a6d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25902025-02-13T05:17:55.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1104faf9-ba44-4473-b59a-2d4b1d692a6d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25912025-02-13T05:17:55.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1104faf9-ba44-4473-b59a-2d4b1d692a6d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
25922025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
25932025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
25942025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
25952025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25962025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
25972025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
25982025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25992025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26002025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
26012025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
26022025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26032025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26042025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
26052025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26062025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
26072025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26082025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
26092025-02-13T05:17:56.240ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26102025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26112025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
26122025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
26132025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26142025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
26152025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
26162025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26172025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
26182025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26192025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26202025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
26212025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26222025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
26232025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26242025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
26252025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26262025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
26272025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26282025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26292025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
26302025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26312025-02-13T05:17:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26322025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26332025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26342025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26352025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26362025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26372025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26382025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26392025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26402025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
26412025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26422025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26432025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26442025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26452025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26462025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26472025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26482025-02-13T05:17:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26492025-02-13T05:17:56.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26502025-02-13T05:17:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26512025-02-13T05:17:56.244ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.479109ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26522025-02-13T05:17:56.244ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 783860000 } })
26532025-02-13T05:17:56.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
26542025-02-13T05:17:56.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26552025-02-13T05:17:56.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26562025-02-13T05:17:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26572025-02-13T05:17:56.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26582025-02-13T05:17:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26592025-02-13T05:17:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26602025-02-13T05:17:56.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26612025-02-13T05:17:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26622025-02-13T05:17:56.255ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 795184902 } })
26632025-02-13T05:17:56.256ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
26642025-02-13T05:17:56.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26652025-02-13T05:17:56.257ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 797254301 } })
26662025-02-13T05:17:56.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26672025-02-13T05:17:56.258ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
26682025-02-13T05:17:56.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.941047ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
26692025-02-13T05:17:56.307ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26702025-02-13T05:17:56.307ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26712025-02-13T05:17:56.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26722025-02-13T05:17:56.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26732025-02-13T05:17:56.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26742025-02-13T05:17:56.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26752025-02-13T05:17:56.309ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26762025-02-13T05:17:56.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26772025-02-13T05:17:56.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26782025-02-13T05:17:56.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26792025-02-13T05:17:56.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26802025-02-13T05:17:56.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26812025-02-13T05:17:56.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26822025-02-13T05:17:56.313ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26832025-02-13T05:17:56.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26842025-02-13T05:17:56.313ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26852025-02-13T05:17:56.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26862025-02-13T05:17:56.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26872025-02-13T05:17:56.314ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26882025-02-13T05:17:56.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
26892025-02-13T05:17:56.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26902025-02-13T05:17:56.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26912025-02-13T05:17:56.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26922025-02-13T05:17:56.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26932025-02-13T05:17:56.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26942025-02-13T05:17:56.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26952025-02-13T05:17:56.315ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26962025-02-13T05:17:56.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26972025-02-13T05:17:56.317ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26982025-02-13T05:17:56.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26992025-02-13T05:17:56.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27002025-02-13T05:17:56.318ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 78.130532ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
27012025-02-13T05:17:56.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27022025-02-13T05:17:56.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.978136ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27032025-02-13T05:17:56.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.985277ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27042025-02-13T05:17:56.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27052025-02-13T05:17:56.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27062025-02-13T05:17:56.322ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27072025-02-13T05:17:56.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27082025-02-13T05:17:56.324ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
27092025-02-13T05:17:56.324ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27102025-02-13T05:17:56.324ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e5ab173-c7b9-4448-b3e6-ec0b355f6667", "content-length": "26", "date": "Thu, 13 Feb 2025 05:17:56 GMT"} })
27112025-02-13T05:17:56.324ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27122025-02-13T05:17:56.327ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27132025-02-13T05:17:56.332ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27142025-02-13T05:17:56.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27152025-02-13T05:17:56.336ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27162025-02-13T05:17:56.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27172025-02-13T05:17:56.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 96.254628ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
27182025-02-13T05:17:56.336ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
27192025-02-13T05:17:56.336ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.32894ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
27202025-02-13T05:17:56.337ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27212025-02-13T05:17:56.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27222025-02-13T05:17:56.346ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27232025-02-13T05:17:56.346ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27242025-02-13T05:17:56.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27252025-02-13T05:17:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27262025-02-13T05:17:56.364ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
27272025-02-13T05:17:56.364ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27282025-02-13T05:17:56.364ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a251d10-6de8-4093-968a-d66f1beeff0e", "content-length": "26", "date": "Thu, 13 Feb 2025 05:17:56 GMT"} })
27292025-02-13T05:17:56.365ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27302025-02-13T05:17:56.365ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27312025-02-13T05:17:56.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27322025-02-13T05:17:56.366ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
27332025-02-13T05:17:56.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 127.421394ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27342025-02-13T05:17:56.368ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27352025-02-13T05:17:56.370ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
27362025-02-13T05:17:56.370ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27372025-02-13T05:17:56.371ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27382025-02-13T05:17:56.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27392025-02-13T05:17:56.371ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "124da225-c8be-4436-917d-30a8464f9b08", "content-length": "26", "date": "Thu, 13 Feb 2025 05:17:56 GMT"} })
27402025-02-13T05:17:56.371ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27412025-02-13T05:17:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27422025-02-13T05:17:56.373ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27432025-02-13T05:17:56.373ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27442025-02-13T05:17:56.373ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.86946ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27452025-02-13T05:17:56.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27462025-02-13T05:17:56.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27472025-02-13T05:17:56.377ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27482025-02-13T05:17:56.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27492025-02-13T05:17:56.380ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27502025-02-13T05:17:56.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27512025-02-13T05:17:56.382ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.902027ms iteration = 21 status = {"physical_disks_added":0}
27522025-02-13T05:17:56.392ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27532025-02-13T05:17:56.392ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27542025-02-13T05:17:56.392ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.593612ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27552025-02-13T05:17:56.410ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27562025-02-13T05:17:56.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27572025-02-13T05:17:56.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27582025-02-13T05:17:56.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
27592025-02-13T05:17:56.412ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27602025-02-13T05:17:56.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27612025-02-13T05:17:56.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27622025-02-13T05:17:56.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
27632025-02-13T05:17:56.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27642025-02-13T05:17:56.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27652025-02-13T05:17:56.429ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 189.042868ms iteration = 20 status = 0
27662025-02-13T05:17:56.433ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 193.453183ms iteration = 20 status = {}
27672025-02-13T05:17:56.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 193.231027ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
27682025-02-13T05:17:56.457ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27692025-02-13T05:17:56.458ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b43a61e5-0ad2-4770-8d15-9a0346174f7f", "content-length": "1", "date": "Thu, 13 Feb 2025 05:17:55 GMT"} })
27702025-02-13T05:17:56.460ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27712025-02-13T05:17:56.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27722025-02-13T05:17:56.460ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
27732025-02-13T05:17:56.460ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 220.506123ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
27742025-02-13T05:17:56.463ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 222.51863ms iteration = 20 status = null
27752025-02-13T05:17:56.528ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27762025-02-13T05:17:56.528ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27772025-02-13T05:17:56.528ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "44e56dfb-3507-4314-bfdb-5891228abf9f", "content-length": "372", "date": "Thu, 13 Feb 2025 05:17:56 GMT"} })
27782025-02-13T05:17:56.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27792025-02-13T05:17:56.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27802025-02-13T05:17:56.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 171ed4dd-420d-48a4-aca1-dc84aae02900 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
27812025-02-13T05:17:56.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 171ed4dd-420d-48a4-aca1-dc84aae02900 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
27822025-02-13T05:17:56.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 171ed4dd-420d-48a4-aca1-dc84aae02900 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
27832025-02-13T05:17:56.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27842025-02-13T05:17:56.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27852025-02-13T05:17:56.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27862025-02-13T05:17:56.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27872025-02-13T05:17:56.569ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
27882025-02-13T05:17:56.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27892025-02-13T05:17:56.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27902025-02-13T05:17:56.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27912025-02-13T05:17:56.576ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27922025-02-13T05:17:56.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27932025-02-13T05:17:56.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27942025-02-13T05:17:56.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27952025-02-13T05:17:56.579ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
27962025-02-13T05:17:56.579ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27972025-02-13T05:17:56.579ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3cbd0f30-53c9-40c8-8ef0-3e865ed2e93e", "date": "Thu, 13 Feb 2025 05:17:56 GMT"} })
27982025-02-13T05:17:56.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27992025-02-13T05:17:56.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28002025-02-13T05:17:56.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28012025-02-13T05:17:56.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28022025-02-13T05:17:56.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28032025-02-13T05:17:56.581ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28042025-02-13T05:17:56.581ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f93d505-970a-474c-8308-6016a525b4ee", "content-length": "134", "date": "Thu, 13 Feb 2025 05:17:55 GMT"} })
28052025-02-13T05:17:56.581ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28062025-02-13T05:17:56.581ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
28072025-02-13T05:17:56.581ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28082025-02-13T05:17:56.581ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28092025-02-13T05:17:56.581ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28102025-02-13T05:17:56.581ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28112025-02-13T05:17:56.581ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28122025-02-13T05:17:56.581ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28132025-02-13T05:17:56.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28142025-02-13T05:17:56.582ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28152025-02-13T05:17:56.582ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28162025-02-13T05:17:56.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28172025-02-13T05:17:56.582ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
28182025-02-13T05:17:56.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28192025-02-13T05:17:56.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28202025-02-13T05:17:56.584ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28212025-02-13T05:17:56.584ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a82359b-ebc8-46f2-9d3b-e391c277517c", "content-length": "2", "date": "Thu, 13 Feb 2025 05:17:55 GMT"} })
28222025-02-13T05:17:56.584ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28232025-02-13T05:17:56.584ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c376820d-0c24-41cc-afc0-54076fbc74a5", "content-length": "52", "date": "Thu, 13 Feb 2025 05:17:55 GMT"} })
28242025-02-13T05:17:56.584ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
28252025-02-13T05:17:56.584ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28262025-02-13T05:17:56.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28272025-02-13T05:17:56.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28282025-02-13T05:17:56.589ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28292025-02-13T05:17:56.589ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28302025-02-13T05:17:56.669ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28312025-02-13T05:17:56.692ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1acf5afa-88b2-4331-b63d-6ae39d8a42c8", "date": "Thu, 13 Feb 2025 05:17:56 GMT"} })
28322025-02-13T05:17:56.692ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
28332025-02-13T05:17:56.692ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28342025-02-13T05:17:56.692ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "99609cf3-37b0-4153-b274-2d86616cd0a8", "content-length": "682", "date": "Thu, 13 Feb 2025 05:17:56 GMT"} })
28352025-02-13T05:17:56.692ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28362025-02-13T05:17:56.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28372025-02-13T05:17:56.693ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9b70561f-f30d-4f19-bd0c-59fc39d2bde0", "date": "Thu, 13 Feb 2025 05:17:56 GMT"} })
28382025-02-13T05:17:56.693ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "828570b1-c80e-4504-9a0b-72bdaaea2fd7", "content-length": "691", "date": "Thu, 13 Feb 2025 05:17:56 GMT"} })
28392025-02-13T05:17:56.693ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
28402025-02-13T05:17:56.693ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
28412025-02-13T05:17:56.693ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
28422025-02-13T05:17:56.694ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 454.21375ms iteration = 20 status = {}
28432025-02-13T05:17:56.695ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 454.703885ms iteration = 20 status = {}
28442025-02-13T05:17:56.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28452025-02-13T05:17:56.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28462025-02-13T05:17:56.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28472025-02-13T05:17:56.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28482025-02-13T05:17:56.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28492025-02-13T05:17:56.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28502025-02-13T05:17:56.710ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 469.918967ms iteration = 20 status = {}
28512025-02-13T05:17:57.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1cd24301-647a-4d12-8b00-dc7abe3b8b10 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28522025-02-13T05:17:57.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1cd24301-647a-4d12-8b00-dc7abe3b8b10 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28532025-02-13T05:17:57.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1cd24301-647a-4d12-8b00-dc7abe3b8b10 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28542025-02-13T05:17:58.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7149881e-a3f0-40ce-8ba9-adee63d6e206 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28552025-02-13T05:17:58.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7149881e-a3f0-40ce-8ba9-adee63d6e206 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28562025-02-13T05:17:58.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7149881e-a3f0-40ce-8ba9-adee63d6e206 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28572025-02-13T05:17:59.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f1446a12-7914-45cc-81c6-6ffe09285c69 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28582025-02-13T05:17:59.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f1446a12-7914-45cc-81c6-6ffe09285c69 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28592025-02-13T05:17:59.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f1446a12-7914-45cc-81c6-6ffe09285c69 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28602025-02-13T05:18:00.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 440 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 91c29a21-9a0b-4990-9586-d0251d618170 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
28612025-02-13T05:18:00.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 02a39c7c-b38e-42d9-ba9a-e423e6811426 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28622025-02-13T05:18:00.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 02a39c7c-b38e-42d9-ba9a-e423e6811426 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28632025-02-13T05:18:00.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2643 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 02a39c7c-b38e-42d9-ba9a-e423e6811426 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28642025-02-13T05:18:01.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bf93d8a2-7aa2-48a9-aa0c-4269fb75c2ec roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28652025-02-13T05:18:01.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bf93d8a2-7aa2-48a9-aa0c-4269fb75c2ec resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28662025-02-13T05:18:01.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1906 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bf93d8a2-7aa2-48a9-aa0c-4269fb75c2ec response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28672025-02-13T05:18:02.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c3d212ea-7026-4df4-8341-f2f37345bcf1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28682025-02-13T05:18:02.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c3d212ea-7026-4df4-8341-f2f37345bcf1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28692025-02-13T05:18:02.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c3d212ea-7026-4df4-8341-f2f37345bcf1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28702025-02-13T05:18:03.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9622ad4-4115-45eb-96be-ef1bd5c3c386 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28712025-02-13T05:18:03.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9622ad4-4115-45eb-96be-ef1bd5c3c386 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28722025-02-13T05:18:03.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9622ad4-4115-45eb-96be-ef1bd5c3c386 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28732025-02-13T05:18:04.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 743dfea5-afa5-425d-a266-66d2e4cc137b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28742025-02-13T05:18:04.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 743dfea5-afa5-425d-a266-66d2e4cc137b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28752025-02-13T05:18:04.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1876 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 743dfea5-afa5-425d-a266-66d2e4cc137b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28762025-02-13T05:18:05.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c4d2afc8-7b89-4271-83a4-ce7016090352 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28772025-02-13T05:18:05.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c4d2afc8-7b89-4271-83a4-ce7016090352 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28782025-02-13T05:18:05.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c4d2afc8-7b89-4271-83a4-ce7016090352 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
28792025-02-13T05:18:06.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
28802025-02-13T05:18:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
28812025-02-13T05:18:06.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28822025-02-13T05:18:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28832025-02-13T05:18:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28842025-02-13T05:18:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28852025-02-13T05:18:06.268ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28862025-02-13T05:18:06.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28872025-02-13T05:18:06.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28882025-02-13T05:18:06.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28892025-02-13T05:18:06.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28902025-02-13T05:18:06.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28912025-02-13T05:18:06.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28922025-02-13T05:18:06.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28932025-02-13T05:18:06.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28942025-02-13T05:18:06.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
28952025-02-13T05:18:06.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28962025-02-13T05:18:06.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28972025-02-13T05:18:06.297ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
28982025-02-13T05:18:06.297ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.085734ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
28992025-02-13T05:18:06.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.212711ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29002025-02-13T05:18:06.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 585827b2-ae1e-4779-b8ef-661017de6821 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29012025-02-13T05:18:06.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 585827b2-ae1e-4779-b8ef-661017de6821 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29022025-02-13T05:18:06.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 585827b2-ae1e-4779-b8ef-661017de6821 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29032025-02-13T05:18:07.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c6c7830a-87cb-4dcc-84cf-8a8c0e4244cc roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29042025-02-13T05:18:07.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c6c7830a-87cb-4dcc-84cf-8a8c0e4244cc resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29052025-02-13T05:18:07.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c6c7830a-87cb-4dcc-84cf-8a8c0e4244cc response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29062025-02-13T05:18:08.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 42c9deb5-891e-4289-9a86-f260c0841305 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29072025-02-13T05:18:08.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 42c9deb5-891e-4289-9a86-f260c0841305 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29082025-02-13T05:18:08.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1879 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 42c9deb5-891e-4289-9a86-f260c0841305 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29092025-02-13T05:18:09.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = af10ec98-e8ed-4890-9edc-0cf13e80ab63 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29102025-02-13T05:18:09.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = af10ec98-e8ed-4890-9edc-0cf13e80ab63 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29112025-02-13T05:18:09.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = af10ec98-e8ed-4890-9edc-0cf13e80ab63 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29122025-02-13T05:18:10.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 370 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = c7f9f8a1-eb9f-400a-b602-cecad89e0c53 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
29132025-02-13T05:18:10.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 56cad0d6-487c-45f3-ad02-e75788942727 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29142025-02-13T05:18:10.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 56cad0d6-487c-45f3-ad02-e75788942727 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29152025-02-13T05:18:10.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1925 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 56cad0d6-487c-45f3-ad02-e75788942727 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29162025-02-13T05:18:11.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e90f2b3c-23b3-4916-acee-e8103ef68872 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29172025-02-13T05:18:11.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e90f2b3c-23b3-4916-acee-e8103ef68872 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29182025-02-13T05:18:11.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e90f2b3c-23b3-4916-acee-e8103ef68872 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29192025-02-13T05:18:12.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6521bb7d-5a18-4b52-802e-73dba7aa2116 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29202025-02-13T05:18:12.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6521bb7d-5a18-4b52-802e-73dba7aa2116 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29212025-02-13T05:18:12.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6521bb7d-5a18-4b52-802e-73dba7aa2116 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29222025-02-13T05:18:13.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5fb48013-e61e-4ef4-99c3-83baf8df9c1b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29232025-02-13T05:18:13.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5fb48013-e61e-4ef4-99c3-83baf8df9c1b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29242025-02-13T05:18:13.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5fb48013-e61e-4ef4-99c3-83baf8df9c1b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29252025-02-13T05:18:14.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a9861be3-a950-448b-93c9-2d9544b9d50e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29262025-02-13T05:18:14.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a9861be3-a950-448b-93c9-2d9544b9d50e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29272025-02-13T05:18:14.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a9861be3-a950-448b-93c9-2d9544b9d50e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29282025-02-13T05:18:15.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c51aa01f-8e04-46cb-bc58-be1df1165d71 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29292025-02-13T05:18:15.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c51aa01f-8e04-46cb-bc58-be1df1165d71 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29302025-02-13T05:18:15.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1895 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c51aa01f-8e04-46cb-bc58-be1df1165d71 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29312025-02-13T05:18:16.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
29322025-02-13T05:18:16.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
29332025-02-13T05:18:16.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29342025-02-13T05:18:16.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29352025-02-13T05:18:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29362025-02-13T05:18:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29372025-02-13T05:18:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29382025-02-13T05:18:16.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29392025-02-13T05:18:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29402025-02-13T05:18:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29412025-02-13T05:18:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29422025-02-13T05:18:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29432025-02-13T05:18:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29442025-02-13T05:18:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29452025-02-13T05:18:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29462025-02-13T05:18:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
29472025-02-13T05:18:16.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29482025-02-13T05:18:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29492025-02-13T05:18:16.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
29502025-02-13T05:18:16.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.542068ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
29512025-02-13T05:18:16.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.313876ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29522025-02-13T05:18:16.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f5aca3a4-8586-4827-84bb-e24586dd971e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29532025-02-13T05:18:16.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f5aca3a4-8586-4827-84bb-e24586dd971e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29542025-02-13T05:18:16.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f5aca3a4-8586-4827-84bb-e24586dd971e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29552025-02-13T05:18:18.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bdd42c3f-e370-4c25-b8e0-e92bfdc912e0 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29562025-02-13T05:18:18.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bdd42c3f-e370-4c25-b8e0-e92bfdc912e0 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29572025-02-13T05:18:18.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bdd42c3f-e370-4c25-b8e0-e92bfdc912e0 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29582025-02-13T05:18:19.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb9c8f6b-1f13-4434-a714-d52495ed9e80 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29592025-02-13T05:18:19.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb9c8f6b-1f13-4434-a714-d52495ed9e80 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29602025-02-13T05:18:19.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2700 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb9c8f6b-1f13-4434-a714-d52495ed9e80 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29612025-02-13T05:18:20.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 62c33445-e554-48a2-a582-c93063d746ae roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29622025-02-13T05:18:20.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 62c33445-e554-48a2-a582-c93063d746ae resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29632025-02-13T05:18:20.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 62c33445-e554-48a2-a582-c93063d746ae response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29642025-02-13T05:18:20.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 363 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = e5c09f30-262c-4f4b-b484-5a32408900bf response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
29652025-02-13T05:18:21.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e9959b4c-9334-4b2b-b4fd-5338369a22a3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29662025-02-13T05:18:21.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e9959b4c-9334-4b2b-b4fd-5338369a22a3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29672025-02-13T05:18:21.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e9959b4c-9334-4b2b-b4fd-5338369a22a3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29682025-02-13T05:18:22.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89aa7e55-c69f-4ae6-a74e-229d358b4180 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29692025-02-13T05:18:22.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89aa7e55-c69f-4ae6-a74e-229d358b4180 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29702025-02-13T05:18:22.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89aa7e55-c69f-4ae6-a74e-229d358b4180 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29712025-02-13T05:18:23.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d16b1640-0e2b-499b-a545-5c4b91035e92 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29722025-02-13T05:18:23.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d16b1640-0e2b-499b-a545-5c4b91035e92 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29732025-02-13T05:18:23.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d16b1640-0e2b-499b-a545-5c4b91035e92 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29742025-02-13T05:18:24.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5ee316bf-f729-4c40-806c-6ee0bd332e1d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29752025-02-13T05:18:24.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5ee316bf-f729-4c40-806c-6ee0bd332e1d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29762025-02-13T05:18:24.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5ee316bf-f729-4c40-806c-6ee0bd332e1d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29772025-02-13T05:18:25.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 653f5bbe-62c3-4730-9a50-f48f0aed6e53 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
29782025-02-13T05:18:25.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 653f5bbe-62c3-4730-9a50-f48f0aed6e53 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
29792025-02-13T05:18:25.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 653f5bbe-62c3-4730-9a50-f48f0aed6e53 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
29802025-02-13T05:18:25.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a75ade6d-f5e6-4b9e-8ce3-8d0d0b3f3d54 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
29812025-02-13T05:18:25.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a75ade6d-f5e6-4b9e-8ce3-8d0d0b3f3d54 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
29822025-02-13T05:18:25.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a75ade6d-f5e6-4b9e-8ce3-8d0d0b3f3d54 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
29832025-02-13T05:18:25.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 46462317-0540-4ba1-9007-f5a9b0f55c72 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29842025-02-13T05:18:25.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 46462317-0540-4ba1-9007-f5a9b0f55c72 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29852025-02-13T05:18:25.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1905 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 46462317-0540-4ba1-9007-f5a9b0f55c72 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29862025-02-13T05:18:26.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 23afa5fb-51cb-470c-be80-21ef2c4aa421 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29872025-02-13T05:18:26.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 23afa5fb-51cb-470c-be80-21ef2c4aa421 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29882025-02-13T05:18:26.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 23afa5fb-51cb-470c-be80-21ef2c4aa421 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
29892025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
29902025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
29912025-02-13T05:18:26.240ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
29922025-02-13T05:18:26.240ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
29932025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
29942025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
29952025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29962025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
29972025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29982025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
29992025-02-13T05:18:26.240ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30002025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
30012025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30022025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30032025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
30042025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30052025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
30062025-02-13T05:18:26.240ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = e132683f-3ab0-4513-890f-86716ec9a9cf
30072025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
30082025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.5\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf"}
30092025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
30102025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30112025-02-13T05:18:26.240ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
30122025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
30132025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30142025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30152025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
30162025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30172025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
30182025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30192025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
30202025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
30212025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30222025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
30232025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30242025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30252025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
30262025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
30272025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30282025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
30292025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
30302025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30312025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
30322025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30332025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Timeout
30342025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
30352025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30362025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
30372025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30382025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
30392025-02-13T05:18:26.240ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-13 05:08:26.240477279 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30402025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30412025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
30422025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
30432025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
30442025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30452025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
30462025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30472025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
30482025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
30492025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
30502025-02-13T05:18:26.240ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
30512025-02-13T05:18:26.240ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30522025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
30532025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30542025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30552025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30562025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
30572025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30582025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
30592025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30602025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
30612025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30622025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
30632025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30642025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30652025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
30662025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30672025-02-13T05:18:26.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
30682025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
30692025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
30702025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30712025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30722025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30732025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30742025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30752025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30762025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30772025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30782025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30792025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30802025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30812025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30822025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
30832025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30842025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30852025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30862025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30872025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
30882025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30892025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30902025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30912025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30922025-02-13T05:18:26.241ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec95727a-7af6-45d1-9962-81bf544db84b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 780743972 } })
30932025-02-13T05:18:26.241ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9f4eb8b3-c464-433c-b912-c7432c124258.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cc24f910-ffb5-4de8-b7e1-4b9d4d15a7cd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 780744642 } })
30942025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30952025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30962025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30972025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30982025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30992025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31002025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
31012025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.015419ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
31022025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
31032025-02-13T05:18:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.369069ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
31042025-02-13T05:18:26.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.16486ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31052025-02-13T05:18:26.245ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
31062025-02-13T05:18:26.245ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
31072025-02-13T05:18:26.245ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.91536ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
31082025-02-13T05:18:26.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 785913159 } })
31092025-02-13T05:18:26.246ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31102025-02-13T05:18:26.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
31112025-02-13T05:18:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31122025-02-13T05:18:26.247ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.818224ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
31132025-02-13T05:18:26.254ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 794083721 } })
31142025-02-13T05:18:26.254ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
31152025-02-13T05:18:26.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31162025-02-13T05:18:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31172025-02-13T05:18:26.258ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-13 05:08:26.240477279 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
31182025-02-13T05:18:26.258ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.953661ms iteration = 11 status = {"expiration":"2025-02-13T05:08:26.240477279Z","pruned":[]}
31192025-02-13T05:18:26.258ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31202025-02-13T05:18:26.261ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31212025-02-13T05:18:26.261ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31222025-02-13T05:18:26.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31232025-02-13T05:18:26.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31242025-02-13T05:18:26.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31252025-02-13T05:18:26.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31262025-02-13T05:18:26.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31272025-02-13T05:18:26.319ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31282025-02-13T05:18:26.319ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31292025-02-13T05:18:26.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31302025-02-13T05:18:26.322ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
31312025-02-13T05:18:26.322ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
31322025-02-13T05:18:26.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
31332025-02-13T05:18:26.324ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31342025-02-13T05:18:26.324ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31352025-02-13T05:18:26.324ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31362025-02-13T05:18:26.324ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31372025-02-13T05:18:26.325ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31382025-02-13T05:18:26.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31392025-02-13T05:18:26.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 85.410249ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
31402025-02-13T05:18:26.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.902744ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
31412025-02-13T05:18:26.326ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31422025-02-13T05:18:26.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31432025-02-13T05:18:26.327ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31442025-02-13T05:18:26.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31452025-02-13T05:18:26.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
31462025-02-13T05:18:26.327ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
31472025-02-13T05:18:26.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
31482025-02-13T05:18:26.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
31492025-02-13T05:18:26.328ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31502025-02-13T05:18:26.328ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
31512025-02-13T05:18:26.328ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 88.396065ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
31522025-02-13T05:18:26.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31532025-02-13T05:18:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
31542025-02-13T05:18:26.330ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31552025-02-13T05:18:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31562025-02-13T05:18:26.331ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31572025-02-13T05:18:26.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31582025-02-13T05:18:26.331ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31592025-02-13T05:18:26.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31602025-02-13T05:18:26.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31612025-02-13T05:18:26.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31622025-02-13T05:18:26.332ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31632025-02-13T05:18:26.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31642025-02-13T05:18:26.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31652025-02-13T05:18:26.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31662025-02-13T05:18:26.333ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 93.142819ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
31672025-02-13T05:18:26.334ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31682025-02-13T05:18:26.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31692025-02-13T05:18:26.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31702025-02-13T05:18:26.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31712025-02-13T05:18:26.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31722025-02-13T05:18:26.336ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31732025-02-13T05:18:26.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31742025-02-13T05:18:26.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31752025-02-13T05:18:26.337ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31762025-02-13T05:18:26.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31772025-02-13T05:18:26.337ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31782025-02-13T05:18:26.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31792025-02-13T05:18:26.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31802025-02-13T05:18:26.338ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31812025-02-13T05:18:26.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31822025-02-13T05:18:26.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31832025-02-13T05:18:26.340ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31842025-02-13T05:18:26.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31852025-02-13T05:18:26.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
31862025-02-13T05:18:26.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31872025-02-13T05:18:26.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31882025-02-13T05:18:26.343ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31892025-02-13T05:18:26.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31902025-02-13T05:18:26.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31912025-02-13T05:18:26.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31922025-02-13T05:18:26.345ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31932025-02-13T05:18:26.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31942025-02-13T05:18:26.346ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.800668ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31952025-02-13T05:18:26.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31962025-02-13T05:18:26.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
31972025-02-13T05:18:26.347ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
31982025-02-13T05:18:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
31992025-02-13T05:18:26.349ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 889225998 } })
32002025-02-13T05:18:26.350ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
32012025-02-13T05:18:26.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32022025-02-13T05:18:26.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32032025-02-13T05:18:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32042025-02-13T05:18:26.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32052025-02-13T05:18:26.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32062025-02-13T05:18:26.351ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32072025-02-13T05:18:26.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32082025-02-13T05:18:26.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32092025-02-13T05:18:26.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32102025-02-13T05:18:26.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32112025-02-13T05:18:26.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32122025-02-13T05:18:26.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32132025-02-13T05:18:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32142025-02-13T05:18:26.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 114.980791ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32152025-02-13T05:18:26.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32162025-02-13T05:18:26.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32172025-02-13T05:18:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32182025-02-13T05:18:26.359ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32192025-02-13T05:18:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32202025-02-13T05:18:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32212025-02-13T05:18:26.363ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32222025-02-13T05:18:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
32232025-02-13T05:18:26.363ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32242025-02-13T05:18:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32252025-02-13T05:18:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32262025-02-13T05:18:26.366ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32272025-02-13T05:18:26.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32282025-02-13T05:18:26.368ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32292025-02-13T05:18:26.368ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32302025-02-13T05:18:26.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32312025-02-13T05:18:26.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32322025-02-13T05:18:26.378ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
32332025-02-13T05:18:26.378ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32342025-02-13T05:18:26.380ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7590a72-3549-46bf-ab1b-7fb561d64da1", "content-length": "26", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
32352025-02-13T05:18:26.380ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32362025-02-13T05:18:26.385ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32372025-02-13T05:18:26.392ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32382025-02-13T05:18:26.392ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32392025-02-13T05:18:26.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32402025-02-13T05:18:26.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32412025-02-13T05:18:26.394ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
32422025-02-13T05:18:26.394ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32432025-02-13T05:18:26.394ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8f97895-f370-4b18-b425-816ce9635877", "content-length": "26", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
32442025-02-13T05:18:26.394ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32452025-02-13T05:18:26.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32462025-02-13T05:18:26.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32472025-02-13T05:18:26.398ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32482025-02-13T05:18:26.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 158.20592ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
32492025-02-13T05:18:26.399ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
32502025-02-13T05:18:26.408ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32512025-02-13T05:18:26.408ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 167.438383ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32522025-02-13T05:18:26.416ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 175.792391ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32532025-02-13T05:18:26.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32542025-02-13T05:18:26.419ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
32552025-02-13T05:18:26.419ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
32562025-02-13T05:18:26.419ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 178.615331ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
32572025-02-13T05:18:26.422ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
32582025-02-13T05:18:26.422ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 182.09601ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
32592025-02-13T05:18:26.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32602025-02-13T05:18:26.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
32612025-02-13T05:18:26.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32622025-02-13T05:18:26.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32632025-02-13T05:18:26.425ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32642025-02-13T05:18:26.425ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32652025-02-13T05:18:26.425ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32662025-02-13T05:18:26.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32672025-02-13T05:18:26.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32682025-02-13T05:18:26.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32692025-02-13T05:18:26.426ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32702025-02-13T05:18:26.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32712025-02-13T05:18:26.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32722025-02-13T05:18:26.427ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32732025-02-13T05:18:26.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32742025-02-13T05:18:26.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32752025-02-13T05:18:26.433ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32762025-02-13T05:18:26.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32772025-02-13T05:18:26.435ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32782025-02-13T05:18:26.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32792025-02-13T05:18:26.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
32802025-02-13T05:18:26.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32812025-02-13T05:18:26.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32822025-02-13T05:18:26.439ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32832025-02-13T05:18:26.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32842025-02-13T05:18:26.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32852025-02-13T05:18:26.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32862025-02-13T05:18:26.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32872025-02-13T05:18:26.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
32882025-02-13T05:18:26.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32892025-02-13T05:18:26.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32902025-02-13T05:18:26.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
32912025-02-13T05:18:26.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32922025-02-13T05:18:26.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32932025-02-13T05:18:26.456ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 214.606864ms iteration = 21 status = 0
32942025-02-13T05:18:26.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32952025-02-13T05:18:26.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32962025-02-13T05:18:26.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32972025-02-13T05:18:26.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
32982025-02-13T05:18:26.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32992025-02-13T05:18:26.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
33002025-02-13T05:18:26.470ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33012025-02-13T05:18:26.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33022025-02-13T05:18:26.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
33032025-02-13T05:18:26.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
33042025-02-13T05:18:26.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
33052025-02-13T05:18:26.476ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33062025-02-13T05:18:26.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33072025-02-13T05:18:26.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33082025-02-13T05:18:26.477ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33092025-02-13T05:18:26.477ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33102025-02-13T05:18:26.477ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 237.630459ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33112025-02-13T05:18:26.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33122025-02-13T05:18:26.483ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33132025-02-13T05:18:26.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33142025-02-13T05:18:26.486ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33152025-02-13T05:18:26.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33162025-02-13T05:18:26.493ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 252.625667ms iteration = 22 status = {"physical_disks_added":0}
33172025-02-13T05:18:26.497ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
33182025-02-13T05:18:26.497ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 256.767114ms iteration = 4 status = {"blueprint_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","inventory_collection_id":"2f60ec98-6729-47f0-b49f-8dcf13c7040f","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
33192025-02-13T05:18:26.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33202025-02-13T05:18:26.514ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
33212025-02-13T05:18:26.514ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 274.319483ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
33222025-02-13T05:18:26.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33232025-02-13T05:18:26.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33242025-02-13T05:18:26.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33252025-02-13T05:18:26.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33262025-02-13T05:18:26.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33272025-02-13T05:18:26.531ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33282025-02-13T05:18:26.531ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33292025-02-13T05:18:26.531ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33302025-02-13T05:18:26.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33312025-02-13T05:18:26.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33322025-02-13T05:18:26.567ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-13T05:08:23.439194Z, time_modified: 2025-02-13T05:08:23.439194Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }) }
33332025-02-13T05:18:26.567ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 326.677503ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]}},"default_endpoint":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33342025-02-13T05:18:26.574ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
33352025-02-13T05:18:26.574ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 333.718883ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33362025-02-13T05:18:26.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33372025-02-13T05:18:26.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33382025-02-13T05:18:26.591ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33392025-02-13T05:18:26.591ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 0 version = 2
33402025-02-13T05:18:26.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33412025-02-13T05:18:26.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33422025-02-13T05:18:26.607ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33432025-02-13T05:18:26.607ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "01b662c1-8d80-4bbe-b0d6-39f730913434", "content-length": "1", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
33442025-02-13T05:18:26.609ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33452025-02-13T05:18:26.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33462025-02-13T05:18:26.620ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(3e7d968e-01d7-4a21-8199-f0cebea6766c, 0), (d786d4db-a607-4a54-adee-d6be4fca06ed, 0), (2f60ec98-6729-47f0-b49f-8dcf13c7040f, 0)]
33472025-02-13T05:18:26.620ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1416, tv_nsec: 160488714 } })
33482025-02-13T05:18:26.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
33492025-02-13T05:18:26.645ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33502025-02-13T05:18:26.648ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3fffc69-65e8-4fbf-8b46-20742642c39d", "content-length": "26", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
33512025-02-13T05:18:26.648ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33522025-02-13T05:18:26.650ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
33532025-02-13T05:18:26.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33542025-02-13T05:18:26.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33552025-02-13T05:18:26.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33562025-02-13T05:18:26.699ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33572025-02-13T05:18:26.700ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b9bf2954-3fa2-4125-ab29-d129703de049", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33582025-02-13T05:18:26.700ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33592025-02-13T05:18:26.701ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "631bb072-33c2-48b9-9a20-6ec5f38a1a2d", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33602025-02-13T05:18:26.701ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33612025-02-13T05:18:26.704ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33622025-02-13T05:18:26.704ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 463.757132ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33632025-02-13T05:18:26.754ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 514.375582ms iteration = 21 status = {}
33642025-02-13T05:18:26.758ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33652025-02-13T05:18:26.758ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33662025-02-13T05:18:26.758ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fc77166-1a1c-43c1-8bb2-80d1b39463a8", "content-length": "372", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
33672025-02-13T05:18:26.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33682025-02-13T05:18:26.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33692025-02-13T05:18:26.772ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
33702025-02-13T05:18:26.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
33712025-02-13T05:18:26.775ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33722025-02-13T05:18:26.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33732025-02-13T05:18:26.776ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 536.079609ms iteration = 21 status = null
33742025-02-13T05:18:26.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33752025-02-13T05:18:26.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33762025-02-13T05:18:26.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33772025-02-13T05:18:26.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33782025-02-13T05:18:26.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
33792025-02-13T05:18:26.779ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33802025-02-13T05:18:26.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33812025-02-13T05:18:26.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33822025-02-13T05:18:26.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33832025-02-13T05:18:26.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33842025-02-13T05:18:26.782ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 1 version = 2
33852025-02-13T05:18:26.782ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33862025-02-13T05:18:26.782ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-13 05:08:27.963644 UTC dns_group = external generation = 2
33872025-02-13T05:18:26.782ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 541.415ms iteration = 11 status = {"generation":2}
33882025-02-13T05:18:26.783ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33892025-02-13T05:18:26.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33902025-02-13T05:18:26.785ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33912025-02-13T05:18:26.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33922025-02-13T05:18:26.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33932025-02-13T05:18:26.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33942025-02-13T05:18:26.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33952025-02-13T05:18:26.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33962025-02-13T05:18:26.791ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33972025-02-13T05:18:26.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33982025-02-13T05:18:26.796ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
33992025-02-13T05:18:26.796ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
34002025-02-13T05:18:26.797ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
34012025-02-13T05:18:26.797ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcc4177c-eb57-4f28-bc68-37e8a5f14b35", "content-length": "476", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34022025-02-13T05:18:26.797ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
34032025-02-13T05:18:26.798ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c229fcd9-067f-4622-a2aa-1c2d0db1fd9d", "content-length": "734", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34042025-02-13T05:18:26.798ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
34052025-02-13T05:18:26.800ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef218d0b-e876-4caa-adf5-7ef51f5dae57", "content-length": "111", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34062025-02-13T05:18:26.800ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
34072025-02-13T05:18:26.800ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5a834c8-a926-4565-8165-40f66db056ab", "content-length": "111", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34082025-02-13T05:18:26.800ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
34092025-02-13T05:18:26.801ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e967c0c3-865c-4f3d-be64-ad1c4f6c110c", "content-length": "167", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34102025-02-13T05:18:26.801ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
34112025-02-13T05:18:26.801ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "73dad8e8-cbb7-4262-bc5a-4869854ae07f", "content-length": "167", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34122025-02-13T05:18:26.801ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
34132025-02-13T05:18:26.801ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "12d68b0d-001d-45df-90b8-82e28f90b2c2", "content-length": "175", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34142025-02-13T05:18:26.801ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
34152025-02-13T05:18:26.801ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeb07b5c-a390-45e4-9af0-65481fcbbda0", "content-length": "175", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34162025-02-13T05:18:26.801ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
34172025-02-13T05:18:26.802ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "04f6c677-9a55-4705-b6ed-c1bacfde3300", "content-length": "702", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34182025-02-13T05:18:26.802ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
34192025-02-13T05:18:26.802ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e6a8428-b0db-436d-891e-9d3d7c56503b", "content-length": "727", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34202025-02-13T05:18:26.802ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
34212025-02-13T05:18:26.802ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "56ab76fe-2f57-420e-9539-b568a05c2353", "content-length": "729", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34222025-02-13T05:18:26.802ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
34232025-02-13T05:18:26.802ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "09bb0580-8465-4481-afdb-5fe59fd2167d", "content-length": "728", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34242025-02-13T05:18:26.802ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
34252025-02-13T05:18:26.802ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5749e496-16c4-4b32-bdca-9011ff7a5037", "content-length": "722", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34262025-02-13T05:18:26.802ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
34272025-02-13T05:18:26.803ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34282025-02-13T05:18:26.803ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2c1d564-6e7b-40ba-8c01-53f79cae5578", "content-length": "109", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34292025-02-13T05:18:26.803ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
34302025-02-13T05:18:26.803ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "25f69b8a-6702-4f28-be58-b1a6941b42d2", "content-length": "109", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34312025-02-13T05:18:26.803ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
34322025-02-13T05:18:26.803ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "82650e56-3681-4e8e-a29b-32f42342122e", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34332025-02-13T05:18:26.803ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34342025-02-13T05:18:26.805ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b91be65-4508-4666-807e-f1c6a7eff458", "content-length": "169", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34352025-02-13T05:18:26.805ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d913655d-72bb-4e9c-bcbc-0bf6dace0dc5", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34362025-02-13T05:18:26.805ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34372025-02-13T05:18:26.805ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
34382025-02-13T05:18:26.806ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8a14052-ff99-4d26-8700-97f449a99223", "content-length": "169", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34392025-02-13T05:18:26.806ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
34402025-02-13T05:18:26.806ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "221c7725-9c2e-42c8-b308-ab9bed57a4fb", "content-length": "178", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34412025-02-13T05:18:26.806ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
34422025-02-13T05:18:26.806ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "38f674fe-7f6a-47b4-ae1d-c7484f8ba5b1", "content-length": "178", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34432025-02-13T05:18:26.806ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
34442025-02-13T05:18:26.806ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2686853-cf48-4315-8bb4-34b62a8f7b7b", "content-length": "702", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34452025-02-13T05:18:26.806ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
34462025-02-13T05:18:26.806ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8f1a562-e86a-47c6-a2e2-bfeb25c32520", "content-length": "727", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34472025-02-13T05:18:26.806ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
34482025-02-13T05:18:26.807ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d43a904d-7a8d-4318-8da5-7fcf09021195", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34492025-02-13T05:18:26.807ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34502025-02-13T05:18:26.807ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ce958bd-2d45-4d34-8815-3ea8f1f4219c", "content-length": "729", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34512025-02-13T05:18:26.807ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
34522025-02-13T05:18:26.807ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "af156d97-2582-4258-8e04-1d172414d037", "content-length": "728", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34532025-02-13T05:18:26.807ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34542025-02-13T05:18:26.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34552025-02-13T05:18:26.808ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34562025-02-13T05:18:26.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 568.09839ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34572025-02-13T05:18:26.809ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34582025-02-13T05:18:26.809ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34592025-02-13T05:18:26.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
34602025-02-13T05:18:26.812ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34612025-02-13T05:18:26.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34622025-02-13T05:18:26.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
34632025-02-13T05:18:26.813ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
34642025-02-13T05:18:26.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
34652025-02-13T05:18:26.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34662025-02-13T05:18:26.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34672025-02-13T05:18:26.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34682025-02-13T05:18:26.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34692025-02-13T05:18:26.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702025-02-13T05:18:26.819ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
34712025-02-13T05:18:26.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34722025-02-13T05:18:26.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34732025-02-13T05:18:26.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34742025-02-13T05:18:26.820ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2a579be-05a8-4ad6-b7d1-f5b9a5f0b669", "content-length": "2", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34752025-02-13T05:18:26.820ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:619 sled = http://[fd00:1122:3344:101::1]:12345
34762025-02-13T05:18:26.822ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 581.976094ms iteration = 3 status = {"last_run_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":3,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"operation":"list","target_sled":"5835b48f-f45d-4fa8-91ed-38d933d73732","time":"2025-02-13T05:08:26.832770262Z"},{"operation":"list","target_sled":"5835b48f-f45d-4fa8-91ed-38d933d73732","time":"2025-02-13T05:13:26.911138021Z"},{"operation":"list","target_sled":"5835b48f-f45d-4fa8-91ed-38d933d73732","time":"2025-02-13T05:18:26.820532329Z"}]}
34772025-02-13T05:18:26.823ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
34782025-02-13T05:18:26.823ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34792025-02-13T05:18:26.823ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "53fd672b-f4aa-4a3e-8909-43fd72997459", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
34802025-02-13T05:18:26.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34812025-02-13T05:18:26.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34822025-02-13T05:18:26.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34832025-02-13T05:18:26.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34842025-02-13T05:18:26.843ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34852025-02-13T05:18:26.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
34862025-02-13T05:18:26.845ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34872025-02-13T05:18:26.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34882025-02-13T05:18:26.853ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34892025-02-13T05:18:26.853ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34902025-02-13T05:18:26.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34912025-02-13T05:18:26.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34922025-02-13T05:18:26.881ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34932025-02-13T05:18:26.884ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34942025-02-13T05:18:26.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34952025-02-13T05:18:26.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34962025-02-13T05:18:26.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
34972025-02-13T05:18:26.887ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34982025-02-13T05:18:26.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34992025-02-13T05:18:26.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35002025-02-13T05:18:26.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35012025-02-13T05:18:26.889ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35022025-02-13T05:18:26.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35032025-02-13T05:18:26.891ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35042025-02-13T05:18:26.891ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35052025-02-13T05:18:26.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35062025-02-13T05:18:26.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35072025-02-13T05:18:26.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35082025-02-13T05:18:26.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35092025-02-13T05:18:26.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35102025-02-13T05:18:26.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35112025-02-13T05:18:26.935ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
35122025-02-13T05:18:26.935ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
35132025-02-13T05:18:26.937ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35142025-02-13T05:18:26.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35152025-02-13T05:18:26.938ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
35162025-02-13T05:18:26.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35172025-02-13T05:18:26.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35182025-02-13T05:18:26.938ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35192025-02-13T05:18:26.938ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35202025-02-13T05:18:26.938ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-13 05:08:26.528706 UTC dns_group = internal generation = 1
35212025-02-13T05:18:26.938ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 698.20773ms iteration = 11 status = {"generation":1}
35222025-02-13T05:18:26.940ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35232025-02-13T05:18:26.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35242025-02-13T05:18:26.942ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35252025-02-13T05:18:26.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35262025-02-13T05:18:26.944ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35272025-02-13T05:18:26.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35282025-02-13T05:18:26.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35292025-02-13T05:18:26.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35302025-02-13T05:18:26.947ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35312025-02-13T05:18:26.948ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35322025-02-13T05:18:26.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "83183d31-7085-4505-ba70-d328ec263ceb", "content-length": "134", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
35332025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35342025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
35352025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35362025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35372025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35382025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35392025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35402025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35412025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35422025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35432025-02-13T05:18:26.949ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
35442025-02-13T05:18:26.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35452025-02-13T05:18:26.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35462025-02-13T05:18:26.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
35472025-02-13T05:18:26.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35482025-02-13T05:18:26.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35492025-02-13T05:18:26.951ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35502025-02-13T05:18:26.951ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aff931b-9372-4199-bd19-f23982e1a916", "content-length": "2", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
35512025-02-13T05:18:26.951ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35522025-02-13T05:18:26.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e176147f-387c-4dc9-9201-ca14e66d65c0", "content-length": "52", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
35532025-02-13T05:18:26.952ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
35542025-02-13T05:18:26.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35552025-02-13T05:18:26.952ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35562025-02-13T05:18:26.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35572025-02-13T05:18:26.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35582025-02-13T05:18:26.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35592025-02-13T05:18:26.955ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35602025-02-13T05:18:26.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
35612025-02-13T05:18:26.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35622025-02-13T05:18:26.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35632025-02-13T05:18:26.964ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35642025-02-13T05:18:26.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35652025-02-13T05:18:26.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35662025-02-13T05:18:26.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35672025-02-13T05:18:26.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35682025-02-13T05:18:26.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35692025-02-13T05:18:26.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35702025-02-13T05:18:26.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35712025-02-13T05:18:26.971ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35722025-02-13T05:18:26.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35732025-02-13T05:18:26.972ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35742025-02-13T05:18:26.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35752025-02-13T05:18:26.974ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35762025-02-13T05:18:26.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35772025-02-13T05:18:26.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35782025-02-13T05:18:26.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
35792025-02-13T05:18:26.979ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35802025-02-13T05:18:26.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35812025-02-13T05:18:26.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35822025-02-13T05:18:26.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35832025-02-13T05:18:26.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35842025-02-13T05:18:26.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35852025-02-13T05:18:26.983ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35862025-02-13T05:18:26.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
35872025-02-13T05:18:26.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35882025-02-13T05:18:26.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35892025-02-13T05:18:26.990ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "adc7dd0f-df9e-427b-904d-1b03459ebb99", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
35902025-02-13T05:18:26.991ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b1da493-97d5-4b6c-927e-39f1b5335627", "content-length": "691", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
35912025-02-13T05:18:26.991ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35922025-02-13T05:18:26.991ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35932025-02-13T05:18:26.991ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35942025-02-13T05:18:26.991ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 751.359033ms iteration = 21 status = {}
35952025-02-13T05:18:26.992ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 752.299849ms iteration = 21 status = {}
35962025-02-13T05:18:26.993ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 32ffb45b-db9b-4edb-91ce-b8d647b82ef5, kind: Service { id: a8269f60-9104-4275-9edc-a31614d5c23e }, name: Name("nexus-a8269f60-9104-4275-9edc-a31614d5c23e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86210250-964c-473a-b05f-690bc99588ac, kind: Service { id: f6817c28-f622-48d8-9425-69a8b0c4c59a }, name: Name("nexus-f6817c28-f622-48d8-9425-69a8b0c4c59a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9713236b-4ca0-45d6-803b-ee3989195d2b, kind: Service { id: 67cd1f2c-6dc2-422f-a2c8-74ebf346d228 }, name: Name("nexus-67cd1f2c-6dc2-422f-a2c8-74ebf346d228"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 123])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: b52770f8-08e7-4014-82c4-bd4251ffc77f, kind: Service { id: ec95727a-7af6-45d1-9962-81bf544db84b }, name: Name("external-dns-ec95727a-7af6-45d1-9962-81bf544db84b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc137de6-ec00-4a98-82db-f15d19cf43ba, kind: Service { id: f580e8f1-7812-496c-8421-463d5f7ea1f8 }, name: Name("external-dns-f580e8f1-7812-496c-8421-463d5f7ea1f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
35972025-02-13T05:18:26.993ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35982025-02-13T05:18:26.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35992025-02-13T05:18:26.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36002025-02-13T05:18:26.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
36012025-02-13T05:18:26.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36022025-02-13T05:18:26.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36032025-02-13T05:18:26.998ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
36042025-02-13T05:18:26.998ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: b52770f8-08e7-4014-82c4-bd4251ffc77f, kind: Service { id: ec95727a-7af6-45d1-9962-81bf544db84b }, name: Name("external-dns-ec95727a-7af6-45d1-9962-81bf544db84b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc137de6-ec00-4a98-82db-f15d19cf43ba, kind: Service { id: f580e8f1-7812-496c-8421-463d5f7ea1f8 }, name: Name("external-dns-f580e8f1-7812-496c-8421-463d5f7ea1f8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 32ffb45b-db9b-4edb-91ce-b8d647b82ef5, kind: Service { id: a8269f60-9104-4275-9edc-a31614d5c23e }, name: Name("nexus-a8269f60-9104-4275-9edc-a31614d5c23e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 86210250-964c-473a-b05f-690bc99588ac, kind: Service { id: f6817c28-f622-48d8-9425-69a8b0c4c59a }, name: Name("nexus-f6817c28-f622-48d8-9425-69a8b0c4c59a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9713236b-4ca0-45d6-803b-ee3989195d2b, kind: Service { id: 67cd1f2c-6dc2-422f-a2c8-74ebf346d228 }, name: Name("nexus-67cd1f2c-6dc2-422f-a2c8-74ebf346d228"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 123])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
36052025-02-13T05:18:26.998ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
36062025-02-13T05:18:27.105ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a4b3cdcd-3ef0-49b9-8c28-a253489fbaec", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
36072025-02-13T05:18:27.105ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
36082025-02-13T05:18:27.105ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36092025-02-13T05:18:27.106ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "196b74a3-c1c6-4bac-809b-7eb78781fb30", "content-length": "682", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
36102025-02-13T05:18:27.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36112025-02-13T05:18:27.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36122025-02-13T05:18:27.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36132025-02-13T05:18:27.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36142025-02-13T05:18:27.112ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 5835b48f-f45d-4fa8-91ed-38d933d73732, time_created: 2025-02-13T05:08:26.146839Z, time_modified: 2025-02-13T05:08:26.146839Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
36152025-02-13T05:18:27.112ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
36162025-02-13T05:18:27.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36172025-02-13T05:18:27.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36182025-02-13T05:18:27.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36192025-02-13T05:18:27.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36202025-02-13T05:18:27.115ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36212025-02-13T05:18:27.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36222025-02-13T05:18:27.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36232025-02-13T05:18:27.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36242025-02-13T05:18:27.117ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36252025-02-13T05:18:27.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
36262025-02-13T05:18:27.125ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 884.485289ms iteration = 21 status = {}
36272025-02-13T05:18:27.150ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
36282025-02-13T05:18:27.155ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "8f7cc506-8ba0-453b-9fbb-583e977f0ace", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
36292025-02-13T05:18:27.156ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
36302025-02-13T05:18:27.156ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 916.15771ms
36312025-02-13T05:18:27.156ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 916.16574ms iteration = 3 status = {}
36322025-02-13T05:18:27.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1a3a495e-cefb-477e-ab10-b8f8da590c08 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
36332025-02-13T05:18:27.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1a3a495e-cefb-477e-ab10-b8f8da590c08 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
36342025-02-13T05:18:27.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1a3a495e-cefb-477e-ab10-b8f8da590c08 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
36352025-02-13T05:18:27.336ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fc6cbcc-84c2-4640-8991-87b600dc6ff0", "content-length": "30794", "date": "Thu, 13 Feb 2025 05:18:26 GMT"} })
36362025-02-13T05:18:27.338ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
36372025-02-13T05:18:27.339ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
36382025-02-13T05:18:27.339ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
36392025-02-13T05:18:27.340ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36402025-02-13T05:18:27.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36412025-02-13T05:18:27.342ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36422025-02-13T05:18:27.344ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
36432025-02-13T05:18:27.344ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36442025-02-13T05:18:27.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36452025-02-13T05:18:27.522ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 7cf9caf8-4aa6-431f-a268-0f9733ad578d file = nexus/db-queries/src/db/datastore/inventory.rs:1010
36462025-02-13T05:18:27.522ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 7cf9caf8-4aa6-431f-a268-0f9733ad578d time_started = 2025-02-13 05:18:26.796953 UTC
36472025-02-13T05:18:27.522ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Dependency
36482025-02-13T05:18:27.522ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.281946585s iteration = 2 status = {"collection_id":"7cf9caf8-4aa6-431f-a268-0f9733ad578d","time_done":"2025-02-13 05:18:27.338982 UTC","time_started":"2025-02-13 05:18:26.796953 UTC"}
36492025-02-13T05:18:27.522ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Dependency
36502025-02-13T05:18:27.522ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36512025-02-13T05:18:27.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36522025-02-13T05:18:27.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36532025-02-13T05:18:27.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36542025-02-13T05:18:27.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36552025-02-13T05:18:27.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36562025-02-13T05:18:27.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36572025-02-13T05:18:27.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36582025-02-13T05:18:27.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36592025-02-13T05:18:27.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
36602025-02-13T05:18:27.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36612025-02-13T05:18:27.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36622025-02-13T05:18:27.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36632025-02-13T05:18:27.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36642025-02-13T05:18:27.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36652025-02-13T05:18:27.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36662025-02-13T05:18:27.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36672025-02-13T05:18:27.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36682025-02-13T05:18:27.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36692025-02-13T05:18:27.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36702025-02-13T05:18:27.569ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 47.008767ms iteration = 23 status = {"physical_disks_added":0}
36712025-02-13T05:18:27.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36722025-02-13T05:18:27.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36732025-02-13T05:18:27.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36742025-02-13T05:18:27.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36752025-02-13T05:18:27.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36762025-02-13T05:18:27.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36772025-02-13T05:18:27.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36782025-02-13T05:18:27.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36792025-02-13T05:18:27.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36802025-02-13T05:18:27.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36812025-02-13T05:18:27.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36822025-02-13T05:18:27.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36832025-02-13T05:18:27.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36842025-02-13T05:18:27.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36852025-02-13T05:18:27.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36862025-02-13T05:18:27.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36872025-02-13T05:18:27.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36882025-02-13T05:18:27.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36892025-02-13T05:18:27.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36902025-02-13T05:18:27.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36912025-02-13T05:18:27.593ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
36922025-02-13T05:18:27.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 71.216416ms iteration = 5 status = {"blueprint_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","inventory_collection_id":"fb4170ca-c951-433b-afd5-306fbd7a1699","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
36932025-02-13T05:18:28.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7a7e2939-7f9d-4f20-9f16-f3b9c7adb438 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
36942025-02-13T05:18:28.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7a7e2939-7f9d-4f20-9f16-f3b9c7adb438 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
36952025-02-13T05:18:28.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3262 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7a7e2939-7f9d-4f20-9f16-f3b9c7adb438 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
36962025-02-13T05:18:29.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0aeceb04-c509-4a21-b8e5-15162bd79ef5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
36972025-02-13T05:18:29.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0aeceb04-c509-4a21-b8e5-15162bd79ef5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
36982025-02-13T05:18:29.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1927 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0aeceb04-c509-4a21-b8e5-15162bd79ef5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
36992025-02-13T05:18:30.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 392 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 35b58dbf-147c-423b-b9ff-0aa5bdc2a47b response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
37002025-02-13T05:18:30.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8b0c9e30-d42b-467c-851e-ada1767a92c1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37012025-02-13T05:18:30.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8b0c9e30-d42b-467c-851e-ada1767a92c1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37022025-02-13T05:18:30.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2784 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8b0c9e30-d42b-467c-851e-ada1767a92c1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37032025-02-13T05:18:31.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dc835033-10b3-4853-b79c-1908361da43b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37042025-02-13T05:18:31.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dc835033-10b3-4853-b79c-1908361da43b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37052025-02-13T05:18:31.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dc835033-10b3-4853-b79c-1908361da43b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37062025-02-13T05:18:32.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fde385bb-8422-4cc6-b7f2-96da12cff910 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37072025-02-13T05:18:32.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fde385bb-8422-4cc6-b7f2-96da12cff910 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37082025-02-13T05:18:32.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fde385bb-8422-4cc6-b7f2-96da12cff910 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37092025-02-13T05:18:33.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ba2053ec-1b4b-486e-93b6-4468654e4896 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37102025-02-13T05:18:33.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ba2053ec-1b4b-486e-93b6-4468654e4896 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37112025-02-13T05:18:33.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1715 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ba2053ec-1b4b-486e-93b6-4468654e4896 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37122025-02-13T05:18:34.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d70a1b9e-2368-491a-805a-538580530d86 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37132025-02-13T05:18:34.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d70a1b9e-2368-491a-805a-538580530d86 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37142025-02-13T05:18:34.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1979 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d70a1b9e-2368-491a-805a-538580530d86 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37152025-02-13T05:18:35.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4e463dfa-8b32-4017-adcb-2e85f4d04726 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37162025-02-13T05:18:35.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4e463dfa-8b32-4017-adcb-2e85f4d04726 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37172025-02-13T05:18:35.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4e463dfa-8b32-4017-adcb-2e85f4d04726 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37182025-02-13T05:18:36.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
37192025-02-13T05:18:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
37202025-02-13T05:18:36.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37212025-02-13T05:18:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37222025-02-13T05:18:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37232025-02-13T05:18:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37242025-02-13T05:18:36.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37252025-02-13T05:18:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37262025-02-13T05:18:36.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37272025-02-13T05:18:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37282025-02-13T05:18:36.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37292025-02-13T05:18:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37302025-02-13T05:18:36.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312025-02-13T05:18:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
37322025-02-13T05:18:36.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37332025-02-13T05:18:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37342025-02-13T05:18:36.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
37352025-02-13T05:18:36.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.091999ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
37362025-02-13T05:18:36.270ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37372025-02-13T05:18:36.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37382025-02-13T05:18:36.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.969726ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37392025-02-13T05:18:36.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 08c22d3c-626b-4411-9ffa-8da76088424b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37402025-02-13T05:18:36.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 08c22d3c-626b-4411-9ffa-8da76088424b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37412025-02-13T05:18:36.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 08c22d3c-626b-4411-9ffa-8da76088424b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37422025-02-13T05:18:37.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89899adf-2c3e-4f22-8214-10d9a4fc8ce7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37432025-02-13T05:18:37.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89899adf-2c3e-4f22-8214-10d9a4fc8ce7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37442025-02-13T05:18:37.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 89899adf-2c3e-4f22-8214-10d9a4fc8ce7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37452025-02-13T05:18:38.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bbe22e9c-566a-4c18-ab48-464a0d850de3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37462025-02-13T05:18:38.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bbe22e9c-566a-4c18-ab48-464a0d850de3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37472025-02-13T05:18:38.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = bbe22e9c-566a-4c18-ab48-464a0d850de3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37482025-02-13T05:18:39.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c27e5ad5-a871-4f4b-af9f-1af7c1a13213 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37492025-02-13T05:18:39.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c27e5ad5-a871-4f4b-af9f-1af7c1a13213 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37502025-02-13T05:18:39.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c27e5ad5-a871-4f4b-af9f-1af7c1a13213 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37512025-02-13T05:18:40.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 377 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 98439586-6920-428b-b46a-f5994c6d6cb0 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
37522025-02-13T05:18:40.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9c49bd02-6a9e-4624-8883-6c1799a49424 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37532025-02-13T05:18:40.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9c49bd02-6a9e-4624-8883-6c1799a49424 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37542025-02-13T05:18:40.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2583 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9c49bd02-6a9e-4624-8883-6c1799a49424 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37552025-02-13T05:18:41.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9dfb41b1-4ded-41d8-9100-ce0711b1d36d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37562025-02-13T05:18:41.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9dfb41b1-4ded-41d8-9100-ce0711b1d36d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37572025-02-13T05:18:41.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9dfb41b1-4ded-41d8-9100-ce0711b1d36d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37582025-02-13T05:18:42.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e058d40a-a744-422f-b78e-b83295503ada roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37592025-02-13T05:18:42.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e058d40a-a744-422f-b78e-b83295503ada resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37602025-02-13T05:18:42.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e058d40a-a744-422f-b78e-b83295503ada response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37612025-02-13T05:18:43.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 19650b9d-96bf-4f09-ab44-3eb87282c779 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37622025-02-13T05:18:43.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 19650b9d-96bf-4f09-ab44-3eb87282c779 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37632025-02-13T05:18:43.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 19650b9d-96bf-4f09-ab44-3eb87282c779 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37642025-02-13T05:18:44.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 40b6e078-65f2-40d6-8520-f1f755fa81e5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37652025-02-13T05:18:44.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 40b6e078-65f2-40d6-8520-f1f755fa81e5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37662025-02-13T05:18:44.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1775 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 40b6e078-65f2-40d6-8520-f1f755fa81e5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37672025-02-13T05:18:45.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d9efee49-2362-4dbe-be96-511a58cb5443 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37682025-02-13T05:18:45.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d9efee49-2362-4dbe-be96-511a58cb5443 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37692025-02-13T05:18:45.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1630 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d9efee49-2362-4dbe-be96-511a58cb5443 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37702025-02-13T05:18:46.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
37712025-02-13T05:18:46.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
37722025-02-13T05:18:46.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37732025-02-13T05:18:46.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37742025-02-13T05:18:46.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37752025-02-13T05:18:46.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37762025-02-13T05:18:46.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37772025-02-13T05:18:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37782025-02-13T05:18:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37792025-02-13T05:18:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37802025-02-13T05:18:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37812025-02-13T05:18:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37822025-02-13T05:18:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37832025-02-13T05:18:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
37842025-02-13T05:18:46.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37852025-02-13T05:18:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37862025-02-13T05:18:46.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
37872025-02-13T05:18:46.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.665005ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
37882025-02-13T05:18:46.269ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37892025-02-13T05:18:46.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37902025-02-13T05:18:46.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.188905ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37912025-02-13T05:18:46.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6ccc1c48-1720-4185-a85f-34ee7e62dc48 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37922025-02-13T05:18:46.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6ccc1c48-1720-4185-a85f-34ee7e62dc48 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37932025-02-13T05:18:46.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6ccc1c48-1720-4185-a85f-34ee7e62dc48 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37942025-02-13T05:18:47.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f5dc7f4e-dffb-4986-8729-469ddcd9e361 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37952025-02-13T05:18:47.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f5dc7f4e-dffb-4986-8729-469ddcd9e361 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37962025-02-13T05:18:47.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f5dc7f4e-dffb-4986-8729-469ddcd9e361 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37972025-02-13T05:18:48.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e04a4a48-fa1d-47d0-8476-8383909c9082 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37982025-02-13T05:18:48.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e04a4a48-fa1d-47d0-8476-8383909c9082 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
37992025-02-13T05:18:48.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e04a4a48-fa1d-47d0-8476-8383909c9082 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38002025-02-13T05:18:49.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fa40c6af-6c6f-46e6-9cf3-b4bc7d9fd14a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38012025-02-13T05:18:49.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fa40c6af-6c6f-46e6-9cf3-b4bc7d9fd14a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38022025-02-13T05:18:49.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2041 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fa40c6af-6c6f-46e6-9cf3-b4bc7d9fd14a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38032025-02-13T05:18:50.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 393 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 91994dd1-fe7c-4ca3-b2b1-7c9e6b3d3183 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
38042025-02-13T05:18:50.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9d439cd4-9e99-4097-8661-3f2fb55e7c5c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38052025-02-13T05:18:50.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9d439cd4-9e99-4097-8661-3f2fb55e7c5c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38062025-02-13T05:18:50.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9d439cd4-9e99-4097-8661-3f2fb55e7c5c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38072025-02-13T05:18:51.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7907cc05-133b-4f59-a4ce-65a5c3d595a6 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38082025-02-13T05:18:51.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7907cc05-133b-4f59-a4ce-65a5c3d595a6 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38092025-02-13T05:18:51.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7907cc05-133b-4f59-a4ce-65a5c3d595a6 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38102025-02-13T05:18:52.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a071e5bd-d97d-45ef-af41-200797dd8e38 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38112025-02-13T05:18:52.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a071e5bd-d97d-45ef-af41-200797dd8e38 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38122025-02-13T05:18:52.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a071e5bd-d97d-45ef-af41-200797dd8e38 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38132025-02-13T05:18:53.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c78818f0-ee29-4d07-ad57-160917e5e757 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38142025-02-13T05:18:53.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c78818f0-ee29-4d07-ad57-160917e5e757 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38152025-02-13T05:18:53.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c78818f0-ee29-4d07-ad57-160917e5e757 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38162025-02-13T05:18:54.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2a1079db-79f2-4daa-882e-6de74a959b42 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38172025-02-13T05:18:54.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2a1079db-79f2-4daa-882e-6de74a959b42 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38182025-02-13T05:18:54.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2a1079db-79f2-4daa-882e-6de74a959b42 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38192025-02-13T05:18:55.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 0f6da88d-343f-40f4-84f4-1409c2d4f69f roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
38202025-02-13T05:18:55.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 0f6da88d-343f-40f4-84f4-1409c2d4f69f resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
38212025-02-13T05:18:55.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3042 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 0f6da88d-343f-40f4-84f4-1409c2d4f69f response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
38222025-02-13T05:18:55.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = f83ec2e7-e0b3-4369-9703-4c873ebfe73f roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
38232025-02-13T05:18:55.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = f83ec2e7-e0b3-4369-9703-4c873ebfe73f resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
38242025-02-13T05:18:55.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2128 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = f83ec2e7-e0b3-4369-9703-4c873ebfe73f response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
38252025-02-13T05:18:55.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 26f92b0a-fe6c-48d1-a3b4-de46de01ac4e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38262025-02-13T05:18:55.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 26f92b0a-fe6c-48d1-a3b4-de46de01ac4e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38272025-02-13T05:18:55.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1841 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 26f92b0a-fe6c-48d1-a3b4-de46de01ac4e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
38282025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
38292025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
38302025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
38312025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
38322025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38332025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38342025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
38352025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38362025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
38372025-02-13T05:18:56.240ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38382025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
38392025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38402025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38412025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
38422025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38432025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
38442025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38452025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38462025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
38472025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
38482025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38492025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38502025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
38512025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38522025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
38532025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38542025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
38552025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38562025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
38572025-02-13T05:18:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
38582025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38592025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38602025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
38612025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38622025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
38632025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
38642025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38652025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
38662025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38672025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
38682025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38692025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38702025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38712025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38722025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38732025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38742025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38752025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38762025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38772025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38782025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38792025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38802025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38812025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38822025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38832025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38842025-02-13T05:18:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38852025-02-13T05:18:56.244ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.274633ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38862025-02-13T05:18:56.244ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 784116228 } })
38872025-02-13T05:18:56.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38882025-02-13T05:18:56.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
38892025-02-13T05:18:56.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38902025-02-13T05:18:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38912025-02-13T05:18:56.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38922025-02-13T05:18:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38932025-02-13T05:18:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38942025-02-13T05:18:56.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38952025-02-13T05:18:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38962025-02-13T05:18:56.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38972025-02-13T05:18:56.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 790151869 } })
38982025-02-13T05:18:56.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
38992025-02-13T05:18:56.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39002025-02-13T05:18:56.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39012025-02-13T05:18:56.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39022025-02-13T05:18:56.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39032025-02-13T05:18:56.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39042025-02-13T05:18:56.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39052025-02-13T05:18:56.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39062025-02-13T05:18:56.262ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 802823490 } })
39072025-02-13T05:18:56.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39082025-02-13T05:18:56.263ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
39092025-02-13T05:18:56.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39102025-02-13T05:18:56.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39112025-02-13T05:18:56.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39122025-02-13T05:18:56.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39132025-02-13T05:18:56.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39142025-02-13T05:18:56.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39152025-02-13T05:18:56.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39162025-02-13T05:18:56.268ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39172025-02-13T05:18:56.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39182025-02-13T05:18:56.271ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39192025-02-13T05:18:56.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39202025-02-13T05:18:56.299ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39212025-02-13T05:18:56.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39222025-02-13T05:18:56.299ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39232025-02-13T05:18:56.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39242025-02-13T05:18:56.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.967442ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
39252025-02-13T05:18:56.305ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 64.545406ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
39262025-02-13T05:18:56.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.218645ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
39272025-02-13T05:18:56.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39282025-02-13T05:18:56.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39292025-02-13T05:18:56.307ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39302025-02-13T05:18:56.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39312025-02-13T05:18:56.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39322025-02-13T05:18:56.309ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39332025-02-13T05:18:56.309ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39342025-02-13T05:18:56.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39352025-02-13T05:18:56.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39362025-02-13T05:18:56.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39372025-02-13T05:18:56.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39382025-02-13T05:18:56.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39392025-02-13T05:18:56.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39402025-02-13T05:18:56.310ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39412025-02-13T05:18:56.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39422025-02-13T05:18:56.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39432025-02-13T05:18:56.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39442025-02-13T05:18:56.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39452025-02-13T05:18:56.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39462025-02-13T05:18:56.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39472025-02-13T05:18:56.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39482025-02-13T05:18:56.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39492025-02-13T05:18:56.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
39502025-02-13T05:18:56.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39512025-02-13T05:18:56.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39522025-02-13T05:18:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39532025-02-13T05:18:56.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39542025-02-13T05:18:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39552025-02-13T05:18:56.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39562025-02-13T05:18:56.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39572025-02-13T05:18:56.329ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.25255ms iteration = 22 status = 0
39582025-02-13T05:18:56.329ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39592025-02-13T05:18:56.329ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.284312ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39602025-02-13T05:18:56.341ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
39612025-02-13T05:18:56.341ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39622025-02-13T05:18:56.342ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b513a848-0a25-4a22-83b4-a5863bbd4810", "content-length": "26", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
39632025-02-13T05:18:56.342ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39642025-02-13T05:18:56.344ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39652025-02-13T05:18:56.345ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.511633ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39662025-02-13T05:18:56.346ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
39672025-02-13T05:18:56.346ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39682025-02-13T05:18:56.346ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c0798ca-9067-4775-a9ca-eba69fc73893", "content-length": "26", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
39692025-02-13T05:18:56.346ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39702025-02-13T05:18:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39712025-02-13T05:18:56.347ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39722025-02-13T05:18:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39732025-02-13T05:18:56.347ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 106.960502ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39742025-02-13T05:18:56.352ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39752025-02-13T05:18:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39762025-02-13T05:18:56.356ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39772025-02-13T05:18:56.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39782025-02-13T05:18:56.358ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39792025-02-13T05:18:56.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39802025-02-13T05:18:56.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 119.011056ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39812025-02-13T05:18:56.360ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
39822025-02-13T05:18:56.360ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 119.88589ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
39832025-02-13T05:18:56.366ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39842025-02-13T05:18:56.366ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39852025-02-13T05:18:56.366ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39862025-02-13T05:18:56.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39872025-02-13T05:18:56.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39882025-02-13T05:18:56.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
39892025-02-13T05:18:56.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39902025-02-13T05:18:56.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39912025-02-13T05:18:56.381ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
39922025-02-13T05:18:56.382ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39932025-02-13T05:18:56.382ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c2aecd1-9669-40e4-9580-5f20e3319742", "content-length": "26", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
39942025-02-13T05:18:56.382ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39952025-02-13T05:18:56.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
39962025-02-13T05:18:56.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 156.645046ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
39972025-02-13T05:18:56.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39982025-02-13T05:18:56.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39992025-02-13T05:18:56.420ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40002025-02-13T05:18:56.420ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40012025-02-13T05:18:56.420ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 179.670311ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40022025-02-13T05:18:56.437ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 196.185241ms iteration = 24 status = {"physical_disks_added":0}
40032025-02-13T05:18:56.455ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 214.949414ms iteration = 22 status = {}
40042025-02-13T05:18:56.458ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40052025-02-13T05:18:56.459ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7178683-9541-438a-96c6-699db3d4b5fc", "content-length": "1", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
40062025-02-13T05:18:56.461ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40072025-02-13T05:18:56.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40082025-02-13T05:18:56.470ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40092025-02-13T05:18:56.470ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40102025-02-13T05:18:56.470ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "804ce35b-1421-4c27-bfcd-ac52b3b8236d", "content-length": "372", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
40112025-02-13T05:18:56.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40122025-02-13T05:18:56.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40132025-02-13T05:18:56.473ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 232.811182ms iteration = 22 status = null
40142025-02-13T05:18:56.482ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
40152025-02-13T05:18:56.482ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 241.933762ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
40162025-02-13T05:18:56.519ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40172025-02-13T05:18:56.519ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40182025-02-13T05:18:56.519ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5366935d-10e7-4af1-aa8e-c7143c314dc9", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
40192025-02-13T05:18:56.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40202025-02-13T05:18:56.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40212025-02-13T05:18:56.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40222025-02-13T05:18:56.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40232025-02-13T05:18:56.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40242025-02-13T05:18:56.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40252025-02-13T05:18:56.529ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40262025-02-13T05:18:56.529ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40272025-02-13T05:18:56.530ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "26082740-9acd-497d-b744-fa129d9df80a", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
40282025-02-13T05:18:56.531ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.770261ms iteration = 22 status = {}
40292025-02-13T05:18:56.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40302025-02-13T05:18:56.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40312025-02-13T05:18:56.538ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
40322025-02-13T05:18:56.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40332025-02-13T05:18:56.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40342025-02-13T05:18:56.548ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40352025-02-13T05:18:56.548ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c34e99c-6628-4715-9a29-ef16729cf087", "content-length": "134", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
40362025-02-13T05:18:56.548ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40372025-02-13T05:18:56.548ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
40382025-02-13T05:18:56.549ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40392025-02-13T05:18:56.549ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40402025-02-13T05:18:56.549ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40412025-02-13T05:18:56.549ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40422025-02-13T05:18:56.549ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40432025-02-13T05:18:56.549ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40442025-02-13T05:18:56.549ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40452025-02-13T05:18:56.549ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40462025-02-13T05:18:56.549ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
40472025-02-13T05:18:56.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40482025-02-13T05:18:56.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40492025-02-13T05:18:56.551ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40502025-02-13T05:18:56.552ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6cd7e57-1591-4d98-8d3e-2ff17328ad44", "content-length": "2", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
40512025-02-13T05:18:56.552ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40522025-02-13T05:18:56.552ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4a13951-70a9-4748-9ab8-3f9483dba3bd", "content-length": "52", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
40532025-02-13T05:18:56.552ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
40542025-02-13T05:18:56.552ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40552025-02-13T05:18:56.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40562025-02-13T05:18:56.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40572025-02-13T05:18:56.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40582025-02-13T05:18:56.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40592025-02-13T05:18:56.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40602025-02-13T05:18:56.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40612025-02-13T05:18:56.613ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40622025-02-13T05:18:56.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40632025-02-13T05:18:56.615ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40642025-02-13T05:18:56.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40652025-02-13T05:18:56.682ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ed923d10-b650-4983-b5e5-edb9a0d60f6e", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
40662025-02-13T05:18:56.682ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
40672025-02-13T05:18:56.682ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40682025-02-13T05:18:56.682ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d017bcb-f287-4df6-b5c4-aca9db622811", "content-length": "682", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
40692025-02-13T05:18:56.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40702025-02-13T05:18:56.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40712025-02-13T05:18:56.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40722025-02-13T05:18:56.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40732025-02-13T05:18:56.690ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40742025-02-13T05:18:56.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40752025-02-13T05:18:56.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40762025-02-13T05:18:56.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40772025-02-13T05:18:56.722ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40782025-02-13T05:18:56.723ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fd8597a-0ed2-413d-822e-2574f41663eb", "content-length": "691", "date": "Thu, 13 Feb 2025 05:18:56 GMT"} })
40792025-02-13T05:18:56.723ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40802025-02-13T05:18:56.723ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40812025-02-13T05:18:56.723ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40822025-02-13T05:18:56.724ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 484.11715ms iteration = 22 status = {}
40832025-02-13T05:18:56.730ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.644178ms iteration = 22 status = {}
40842025-02-13T05:18:56.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 98fcbd95-a042-4666-b031-096d22d2417d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40852025-02-13T05:18:56.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 98fcbd95-a042-4666-b031-096d22d2417d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40862025-02-13T05:18:56.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 98fcbd95-a042-4666-b031-096d22d2417d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40872025-02-13T05:18:57.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4c8d2ddd-9bbb-41dc-9c13-bc147469ca65 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40882025-02-13T05:18:57.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4c8d2ddd-9bbb-41dc-9c13-bc147469ca65 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40892025-02-13T05:18:57.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4c8d2ddd-9bbb-41dc-9c13-bc147469ca65 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40902025-02-13T05:18:58.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 00374997-98ba-49fd-9c0a-834c6d231768 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40912025-02-13T05:18:58.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 00374997-98ba-49fd-9c0a-834c6d231768 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40922025-02-13T05:18:58.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 00374997-98ba-49fd-9c0a-834c6d231768 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40932025-02-13T05:18:59.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c814726b-73c7-4943-8c87-2592ec6ccfa3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40942025-02-13T05:18:59.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c814726b-73c7-4943-8c87-2592ec6ccfa3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40952025-02-13T05:18:59.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5122 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c814726b-73c7-4943-8c87-2592ec6ccfa3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40962025-02-13T05:19:00.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 448 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 5a43e7e1-41d0-483c-81b1-08375f69a8dc response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
40972025-02-13T05:19:00.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b8932239-fe31-4600-b437-bf5bc9226a04 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40982025-02-13T05:19:00.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b8932239-fe31-4600-b437-bf5bc9226a04 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
40992025-02-13T05:19:00.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b8932239-fe31-4600-b437-bf5bc9226a04 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41002025-02-13T05:19:01.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ab9d38e8-9e49-4d6a-8bd8-8403ba5928e7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41012025-02-13T05:19:01.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ab9d38e8-9e49-4d6a-8bd8-8403ba5928e7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41022025-02-13T05:19:01.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1685 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ab9d38e8-9e49-4d6a-8bd8-8403ba5928e7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41032025-02-13T05:19:03.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 010cc2eb-c396-4762-8622-2c90baaeb2de roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41042025-02-13T05:19:03.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 010cc2eb-c396-4762-8622-2c90baaeb2de resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41052025-02-13T05:19:03.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 010cc2eb-c396-4762-8622-2c90baaeb2de response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41062025-02-13T05:19:04.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 801f4bc5-7168-487b-8dd3-e8825d96355b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41072025-02-13T05:19:04.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 801f4bc5-7168-487b-8dd3-e8825d96355b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41082025-02-13T05:19:04.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 801f4bc5-7168-487b-8dd3-e8825d96355b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41092025-02-13T05:19:05.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 849ae92d-a9b5-406f-878e-30f3d5e0f54c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41102025-02-13T05:19:05.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 849ae92d-a9b5-406f-878e-30f3d5e0f54c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41112025-02-13T05:19:05.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 849ae92d-a9b5-406f-878e-30f3d5e0f54c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41122025-02-13T05:19:06.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9254aa7b-44d3-43da-8b37-5d0d224ac82f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41132025-02-13T05:19:06.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9254aa7b-44d3-43da-8b37-5d0d224ac82f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41142025-02-13T05:19:06.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9254aa7b-44d3-43da-8b37-5d0d224ac82f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41152025-02-13T05:19:06.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
41162025-02-13T05:19:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
41172025-02-13T05:19:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41182025-02-13T05:19:06.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41192025-02-13T05:19:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41202025-02-13T05:19:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41212025-02-13T05:19:06.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41222025-02-13T05:19:06.269ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41232025-02-13T05:19:06.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41242025-02-13T05:19:06.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41252025-02-13T05:19:06.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41262025-02-13T05:19:06.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41272025-02-13T05:19:06.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41282025-02-13T05:19:06.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41292025-02-13T05:19:06.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41302025-02-13T05:19:06.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
41312025-02-13T05:19:06.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41322025-02-13T05:19:06.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41332025-02-13T05:19:06.285ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
41342025-02-13T05:19:06.285ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.604877ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
41352025-02-13T05:19:06.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.183223ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41362025-02-13T05:19:07.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cf23e2cf-5b21-40e2-a799-14888e0983c8 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41372025-02-13T05:19:07.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cf23e2cf-5b21-40e2-a799-14888e0983c8 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41382025-02-13T05:19:07.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1937 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cf23e2cf-5b21-40e2-a799-14888e0983c8 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41392025-02-13T05:19:08.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 23edf48e-0de2-4a9e-b620-b7ec717df8af roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41402025-02-13T05:19:08.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 23edf48e-0de2-4a9e-b620-b7ec717df8af resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41412025-02-13T05:19:08.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 23edf48e-0de2-4a9e-b620-b7ec717df8af response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41422025-02-13T05:19:09.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 167667ff-e1ca-402e-8447-9bd90ad336ff roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41432025-02-13T05:19:09.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 167667ff-e1ca-402e-8447-9bd90ad336ff resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41442025-02-13T05:19:09.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3414 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 167667ff-e1ca-402e-8447-9bd90ad336ff response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41452025-02-13T05:19:10.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 446 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 9c3ffe48-ae45-421a-8b3d-f2ef01b34eef response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
41462025-02-13T05:19:10.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09db2ceb-5027-4a6d-8ed5-585346a4cbf6 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41472025-02-13T05:19:10.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09db2ceb-5027-4a6d-8ed5-585346a4cbf6 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41482025-02-13T05:19:10.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3619 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09db2ceb-5027-4a6d-8ed5-585346a4cbf6 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41492025-02-13T05:19:11.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 59bd5cd1-0569-4b4a-9b45-3c383de7922a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41502025-02-13T05:19:11.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 59bd5cd1-0569-4b4a-9b45-3c383de7922a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41512025-02-13T05:19:11.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 59bd5cd1-0569-4b4a-9b45-3c383de7922a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41522025-02-13T05:19:12.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4d1e84d8-d52c-42a6-85ac-ac155be7d56b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41532025-02-13T05:19:12.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4d1e84d8-d52c-42a6-85ac-ac155be7d56b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41542025-02-13T05:19:12.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4d1e84d8-d52c-42a6-85ac-ac155be7d56b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41552025-02-13T05:19:13.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a5b4954f-bbbd-40f4-8271-248c77e83d59 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41562025-02-13T05:19:13.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a5b4954f-bbbd-40f4-8271-248c77e83d59 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41572025-02-13T05:19:13.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a5b4954f-bbbd-40f4-8271-248c77e83d59 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41582025-02-13T05:19:14.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 991aa161-997e-44cd-8fc1-9fac737e4dde roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41592025-02-13T05:19:14.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 991aa161-997e-44cd-8fc1-9fac737e4dde resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41602025-02-13T05:19:14.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 991aa161-997e-44cd-8fc1-9fac737e4dde response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41612025-02-13T05:19:15.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = be1c8421-c480-482e-bad2-3996fd5892cf roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41622025-02-13T05:19:15.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = be1c8421-c480-482e-bad2-3996fd5892cf resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41632025-02-13T05:19:15.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2825 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = be1c8421-c480-482e-bad2-3996fd5892cf response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41642025-02-13T05:19:16.207ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 783fce27-e546-4e3b-91f5-b68a22c014d6 remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fd03308a-3add-45bf-b85b-86ddee24576e uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-13T05:19:16.186876247Z }
41652025-02-13T05:19:16.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fd03308a-3add-45bf-b85b-86ddee24576e roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
41662025-02-13T05:19:16.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fd03308a-3add-45bf-b85b-86ddee24576e resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
41672025-02-13T05:19:16.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
41682025-02-13T05:19:16.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
41692025-02-13T05:19:16.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41702025-02-13T05:19:16.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41712025-02-13T05:19:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41722025-02-13T05:19:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41732025-02-13T05:19:16.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41742025-02-13T05:19:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41752025-02-13T05:19:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41762025-02-13T05:19:16.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.936694ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41772025-02-13T05:19:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41782025-02-13T05:19:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41792025-02-13T05:19:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41802025-02-13T05:19:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41812025-02-13T05:19:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41822025-02-13T05:19:16.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75311 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fd03308a-3add-45bf-b85b-86ddee24576e response_code = 204 uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
41832025-02-13T05:19:16.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41842025-02-13T05:19:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
41852025-02-13T05:19:16.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41862025-02-13T05:19:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41872025-02-13T05:19:16.287ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
41882025-02-13T05:19:16.287ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.317986ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
41892025-02-13T05:19:16.290ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 783fce27-e546-4e3b-91f5-b68a22c014d6 remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fde91bb0-872b-484c-9ad5-18388cb6ab27 uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-13T05:19:16.290348710Z }
41902025-02-13T05:19:16.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fde91bb0-872b-484c-9ad5-18388cb6ab27 roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
41912025-02-13T05:19:16.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fde91bb0-872b-484c-9ad5-18388cb6ab27 resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
41922025-02-13T05:19:16.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52991 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fde91bb0-872b-484c-9ad5-18388cb6ab27 response_code = 204 uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
41932025-02-13T05:19:16.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3fef4072-150f-4e9b-9f8b-374449c4e7ce roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41942025-02-13T05:19:16.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3fef4072-150f-4e9b-9f8b-374449c4e7ce resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41952025-02-13T05:19:16.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3fef4072-150f-4e9b-9f8b-374449c4e7ce response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41962025-02-13T05:19:17.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 66eb2e43-c950-47cb-b61f-b06bbd4c95ae roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41972025-02-13T05:19:17.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 66eb2e43-c950-47cb-b61f-b06bbd4c95ae resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41982025-02-13T05:19:17.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 66eb2e43-c950-47cb-b61f-b06bbd4c95ae response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
41992025-02-13T05:19:18.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 872e5710-cbf2-4766-8c13-6f7313fb793c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42002025-02-13T05:19:18.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 872e5710-cbf2-4766-8c13-6f7313fb793c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42012025-02-13T05:19:18.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 872e5710-cbf2-4766-8c13-6f7313fb793c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42022025-02-13T05:19:19.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 22adeca2-2018-440d-845b-43866b7341bf roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42032025-02-13T05:19:19.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 22adeca2-2018-440d-845b-43866b7341bf resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42042025-02-13T05:19:19.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2726 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 22adeca2-2018-440d-845b-43866b7341bf response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42052025-02-13T05:19:20.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 445 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = f091e2bc-993e-47b6-baf9-ad509f72a5bb response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
42062025-02-13T05:19:20.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 901e876b-6b34-4a34-930a-e7c8aa49fb43 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42072025-02-13T05:19:20.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 901e876b-6b34-4a34-930a-e7c8aa49fb43 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42082025-02-13T05:19:20.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 901e876b-6b34-4a34-930a-e7c8aa49fb43 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42092025-02-13T05:19:21.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dd38415f-e281-457c-8244-8406559b6f93 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42102025-02-13T05:19:21.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dd38415f-e281-457c-8244-8406559b6f93 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42112025-02-13T05:19:21.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dd38415f-e281-457c-8244-8406559b6f93 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42122025-02-13T05:19:22.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e0ca2656-e764-4f10-945c-0c2c6bfc9b16 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42132025-02-13T05:19:22.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e0ca2656-e764-4f10-945c-0c2c6bfc9b16 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42142025-02-13T05:19:22.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e0ca2656-e764-4f10-945c-0c2c6bfc9b16 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42152025-02-13T05:19:23.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 97bf9e59-9256-49bd-b499-636154fe090f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42162025-02-13T05:19:23.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 97bf9e59-9256-49bd-b499-636154fe090f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42172025-02-13T05:19:23.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 97bf9e59-9256-49bd-b499-636154fe090f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42182025-02-13T05:19:24.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cadf6d9e-2dae-44c2-801f-6c6736815397 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42192025-02-13T05:19:24.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cadf6d9e-2dae-44c2-801f-6c6736815397 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42202025-02-13T05:19:24.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cadf6d9e-2dae-44c2-801f-6c6736815397 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42212025-02-13T05:19:25.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 68bb7da5-c2b0-4f6d-99a7-888d9bfb7d3c roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
42222025-02-13T05:19:25.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 68bb7da5-c2b0-4f6d-99a7-888d9bfb7d3c resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
42232025-02-13T05:19:25.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3038 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 68bb7da5-c2b0-4f6d-99a7-888d9bfb7d3c response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
42242025-02-13T05:19:25.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = fb0d4c92-e6db-4c0f-a678-ad6bba58aa0e roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
42252025-02-13T05:19:25.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = fb0d4c92-e6db-4c0f-a678-ad6bba58aa0e resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
42262025-02-13T05:19:25.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2643 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = fb0d4c92-e6db-4c0f-a678-ad6bba58aa0e response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
42272025-02-13T05:19:25.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fe73f85c-a07a-4d23-bddd-30f0f0c85882 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42282025-02-13T05:19:25.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fe73f85c-a07a-4d23-bddd-30f0f0c85882 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42292025-02-13T05:19:25.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fe73f85c-a07a-4d23-bddd-30f0f0c85882 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
42302025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
42312025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
42322025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
42332025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42342025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
42352025-02-13T05:19:26.239ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-13 05:09:26.239615920 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42362025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
42372025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42382025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
42392025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42402025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42412025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42422025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
42432025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42442025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42452025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
42462025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
42472025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
42482025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42492025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
42502025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
42512025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42522025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
42532025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
42542025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
42552025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42562025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42572025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
42582025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42592025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
42602025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42612025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
42622025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
42632025-02-13T05:19:26.239ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = e132683f-3ab0-4513-890f-86716ec9a9cf
42642025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42652025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.89\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf"}
42662025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
42672025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
42682025-02-13T05:19:26.239ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42692025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
42702025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42712025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42722025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42732025-02-13T05:19:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
42742025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42752025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
42762025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
42772025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42782025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42792025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42802025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
42812025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42822025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
42832025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42842025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
42852025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42862025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
42872025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42882025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
42892025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42902025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
42912025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
42922025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42932025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
42942025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
42952025-02-13T05:19:26.240ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42962025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42972025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42982025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42992025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43002025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43012025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43022025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43032025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43042025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43052025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43062025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43072025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43082025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43092025-02-13T05:19:26.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9f4eb8b3-c464-433c-b912-c7432c124258.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cc24f910-ffb5-4de8-b7e1-4b9d4d15a7cd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 780645909 } })
43102025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43112025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43122025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43132025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43142025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43152025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43162025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43172025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43182025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43192025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43202025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43212025-02-13T05:19:26.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec95727a-7af6-45d1-9962-81bf544db84b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 780714651 } })
43222025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43232025-02-13T05:19:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43242025-02-13T05:19:26.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
43252025-02-13T05:19:26.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
43262025-02-13T05:19:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.42163ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
43272025-02-13T05:19:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.377719ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
43282025-02-13T05:19:26.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43292025-02-13T05:19:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43302025-02-13T05:19:26.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43312025-02-13T05:19:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43322025-02-13T05:19:26.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43332025-02-13T05:19:26.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.832339ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43342025-02-13T05:19:26.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43352025-02-13T05:19:26.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43362025-02-13T05:19:26.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43372025-02-13T05:19:26.244ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-13 05:09:26.239615920 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43382025-02-13T05:19:26.245ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.387964ms iteration = 12 status = {"expiration":"2025-02-13T05:09:26.239615920Z","pruned":[]}
43392025-02-13T05:19:26.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43402025-02-13T05:19:26.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43412025-02-13T05:19:26.247ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.846184ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
43422025-02-13T05:19:26.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43432025-02-13T05:19:26.247ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43442025-02-13T05:19:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43452025-02-13T05:19:26.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43462025-02-13T05:19:26.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43472025-02-13T05:19:26.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43482025-02-13T05:19:26.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 790225331 } })
43492025-02-13T05:19:26.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
43502025-02-13T05:19:26.253ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 793843184 } })
43512025-02-13T05:19:26.254ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
43522025-02-13T05:19:26.256ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532025-02-13T05:19:26.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43542025-02-13T05:19:26.259ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43552025-02-13T05:19:26.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43562025-02-13T05:19:26.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43572025-02-13T05:19:26.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43582025-02-13T05:19:26.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43592025-02-13T05:19:26.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43602025-02-13T05:19:26.272ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43612025-02-13T05:19:26.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43622025-02-13T05:19:26.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43632025-02-13T05:19:26.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43642025-02-13T05:19:26.297ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43652025-02-13T05:19:26.297ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43662025-02-13T05:19:26.297ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.291008ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43672025-02-13T05:19:26.304ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 65.237636ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
43682025-02-13T05:19:26.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43692025-02-13T05:19:26.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43702025-02-13T05:19:26.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43712025-02-13T05:19:26.312ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43722025-02-13T05:19:26.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43732025-02-13T05:19:26.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43742025-02-13T05:19:26.315ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43752025-02-13T05:19:26.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43762025-02-13T05:19:26.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43772025-02-13T05:19:26.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43782025-02-13T05:19:26.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43792025-02-13T05:19:26.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43802025-02-13T05:19:26.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43812025-02-13T05:19:26.318ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43822025-02-13T05:19:26.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.645378ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
43832025-02-13T05:19:26.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.942095ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43842025-02-13T05:19:26.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43852025-02-13T05:19:26.319ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43862025-02-13T05:19:26.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.875522ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
43872025-02-13T05:19:26.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43882025-02-13T05:19:26.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43892025-02-13T05:19:26.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43902025-02-13T05:19:26.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
43912025-02-13T05:19:26.322ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43922025-02-13T05:19:26.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43932025-02-13T05:19:26.324ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43942025-02-13T05:19:26.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952025-02-13T05:19:26.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43962025-02-13T05:19:26.324ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43972025-02-13T05:19:26.324ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43982025-02-13T05:19:26.324ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43992025-02-13T05:19:26.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44002025-02-13T05:19:26.325ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44012025-02-13T05:19:26.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44022025-02-13T05:19:26.327ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44032025-02-13T05:19:26.327ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44042025-02-13T05:19:26.327ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44052025-02-13T05:19:26.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44062025-02-13T05:19:26.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44072025-02-13T05:19:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44082025-02-13T05:19:26.329ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44092025-02-13T05:19:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44102025-02-13T05:19:26.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44112025-02-13T05:19:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44122025-02-13T05:19:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44132025-02-13T05:19:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44142025-02-13T05:19:26.341ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44152025-02-13T05:19:26.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44162025-02-13T05:19:26.342ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44172025-02-13T05:19:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44182025-02-13T05:19:26.345ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44192025-02-13T05:19:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44202025-02-13T05:19:26.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.089396ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44212025-02-13T05:19:26.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44222025-02-13T05:19:26.362ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44232025-02-13T05:19:26.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44242025-02-13T05:19:26.368ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44252025-02-13T05:19:26.368ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44262025-02-13T05:19:26.368ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44272025-02-13T05:19:26.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44282025-02-13T05:19:26.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44292025-02-13T05:19:26.373ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44302025-02-13T05:19:26.388ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
44312025-02-13T05:19:26.388ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44322025-02-13T05:19:26.388ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87326182-6e34-4c6c-b12c-ef15e6f98a01", "content-length": "26", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
44332025-02-13T05:19:26.388ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44342025-02-13T05:19:26.391ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44352025-02-13T05:19:26.396ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
44362025-02-13T05:19:26.396ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44372025-02-13T05:19:26.397ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a99ad8c8-7a62-403d-a1d2-3c4f09641474", "content-length": "26", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
44382025-02-13T05:19:26.397ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44392025-02-13T05:19:26.399ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44402025-02-13T05:19:26.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44412025-02-13T05:19:26.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44422025-02-13T05:19:26.476ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/783fce27-e546-4e3b-91f5-b68a22c014d6/state
44432025-02-13T05:19:26.477ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/783fce27-e546-4e3b-91f5-b68a22c014d6/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3d34286-02b0-4086-bf9a-9bf5fa17907d", "content-length": "130", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
44442025-02-13T05:19:26.477ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 sled_id = 5835b48f-f45d-4fa8-91ed-38d933d73732 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-13T05:19:16.290348710Z }, migration_in: None, migration_out: None } vmm_id = 783fce27-e546-4e3b-91f5-b68a22c014d6
44452025-02-13T05:19:26.477ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2078 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 783fce27-e546-4e3b-91f5-b68a22c014d6 sled_id = 5835b48f-f45d-4fa8-91ed-38d933d73732 vmm_id = 783fce27-e546-4e3b-91f5-b68a22c014d6 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-13T05:19:16.290348710Z }
44462025-02-13T05:19:26.477ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 roles = RoleSet { roles: {} } sled_id = 5835b48f-f45d-4fa8-91ed-38d933d73732 vmm_id = 783fce27-e546-4e3b-91f5-b68a22c014d6
44472025-02-13T05:19:26.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 resource = Database result = Ok(()) sled_id = 5835b48f-f45d-4fa8-91ed-38d933d73732 vmm_id = 783fce27-e546-4e3b-91f5-b68a22c014d6
44482025-02-13T05:19:26.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44492025-02-13T05:19:26.481ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1476, tv_nsec: 21851160 } })
44502025-02-13T05:19:26.481ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44512025-02-13T05:19:26.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44522025-02-13T05:19:26.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44532025-02-13T05:19:26.482ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
44542025-02-13T05:19:26.484ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44552025-02-13T05:19:26.485ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44562025-02-13T05:19:26.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44572025-02-13T05:19:26.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44582025-02-13T05:19:26.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44592025-02-13T05:19:26.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44602025-02-13T05:19:26.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44612025-02-13T05:19:26.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44622025-02-13T05:19:26.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44632025-02-13T05:19:26.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44642025-02-13T05:19:26.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44652025-02-13T05:19:26.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44662025-02-13T05:19:26.529ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44672025-02-13T05:19:26.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44682025-02-13T05:19:26.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44692025-02-13T05:19:26.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44702025-02-13T05:19:26.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44712025-02-13T05:19:26.541ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44722025-02-13T05:19:26.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44732025-02-13T05:19:26.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 303.699639ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44742025-02-13T05:19:26.546ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44752025-02-13T05:19:26.546ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44762025-02-13T05:19:26.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44772025-02-13T05:19:26.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44782025-02-13T05:19:26.552ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44792025-02-13T05:19:26.552ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44802025-02-13T05:19:26.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44812025-02-13T05:19:26.552ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44822025-02-13T05:19:26.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44832025-02-13T05:19:26.553ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4549462f-16fe-4e3e-b92b-82932ccd6072", "content-length": "2", "date": "Thu, 13 Feb 2025 05:19:25 GMT"} })
44842025-02-13T05:19:26.553ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
44852025-02-13T05:19:26.555ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 315.615038ms iteration = 25 status = {"physical_disks_added":0}
44862025-02-13T05:19:26.557ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44872025-02-13T05:19:26.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44882025-02-13T05:19:26.558ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 318.896541ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
44892025-02-13T05:19:26.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44902025-02-13T05:19:26.560ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 320.648401ms iteration = 23 status = null
44912025-02-13T05:19:26.561ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44922025-02-13T05:19:26.561ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44932025-02-13T05:19:26.561ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 321.209287ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44942025-02-13T05:19:26.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44952025-02-13T05:19:26.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
44962025-02-13T05:19:26.564ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44972025-02-13T05:19:26.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
44982025-02-13T05:19:26.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44992025-02-13T05:19:26.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45002025-02-13T05:19:26.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45012025-02-13T05:19:26.566ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45022025-02-13T05:19:26.566ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 0 version = 2
45032025-02-13T05:19:26.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45042025-02-13T05:19:26.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45052025-02-13T05:19:26.567ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 327.759284ms iteration = 23 status = 0
45062025-02-13T05:19:26.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96176d81-6989-428d-b86c-710afc7462b8 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
45072025-02-13T05:19:26.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96176d81-6989-428d-b86c-710afc7462b8 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
45082025-02-13T05:19:26.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2624 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96176d81-6989-428d-b86c-710afc7462b8 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
45092025-02-13T05:19:26.583ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 343.601134ms iteration = 23 status = {}
45102025-02-13T05:19:26.584ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45112025-02-13T05:19:26.584ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
45122025-02-13T05:19:26.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 344.829168ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
45132025-02-13T05:19:26.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
45142025-02-13T05:19:26.587ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45152025-02-13T05:19:26.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45162025-02-13T05:19:26.588ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
45172025-02-13T05:19:26.588ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 349.076279ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
45182025-02-13T05:19:26.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45192025-02-13T05:19:26.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45202025-02-13T05:19:26.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45212025-02-13T05:19:26.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45222025-02-13T05:19:26.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 354.33663ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
45232025-02-13T05:19:26.598ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45242025-02-13T05:19:26.598ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45252025-02-13T05:19:26.598ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 358.646801ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45262025-02-13T05:19:26.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272025-02-13T05:19:26.600ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45282025-02-13T05:19:26.600ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e5b6a69a-e56d-4d81-aacb-6256cac1a2b2", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45292025-02-13T05:19:26.600ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45302025-02-13T05:19:26.602ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5778764f-cd42-46f4-a8ae-c11c9edd40c8", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45312025-02-13T05:19:26.602ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45322025-02-13T05:19:26.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45332025-02-13T05:19:26.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45342025-02-13T05:19:26.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45352025-02-13T05:19:26.603ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45362025-02-13T05:19:26.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 363.590193ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45372025-02-13T05:19:26.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45382025-02-13T05:19:26.605ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45392025-02-13T05:19:26.605ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45402025-02-13T05:19:26.605ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-13 05:08:26.528706 UTC dns_group = internal generation = 1
45412025-02-13T05:19:26.605ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 365.565189ms iteration = 12 status = {"generation":1}
45422025-02-13T05:19:26.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45432025-02-13T05:19:26.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45442025-02-13T05:19:26.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45452025-02-13T05:19:26.609ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 1 version = 2
45462025-02-13T05:19:26.609ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45472025-02-13T05:19:26.609ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-13 05:08:27.963644 UTC dns_group = external generation = 2
45482025-02-13T05:19:26.609ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 369.938223ms iteration = 12 status = {"generation":2}
45492025-02-13T05:19:26.627ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-13T05:08:23.439194Z, time_modified: 2025-02-13T05:08:23.439194Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
45502025-02-13T05:19:26.627ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 387.326648ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]}},"default_endpoint":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
45512025-02-13T05:19:26.637ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
45522025-02-13T05:19:26.637ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 397.292901ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45532025-02-13T05:19:26.638ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45542025-02-13T05:19:26.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45552025-02-13T05:19:26.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45562025-02-13T05:19:26.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45572025-02-13T05:19:26.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45582025-02-13T05:19:26.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45592025-02-13T05:19:26.642ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45602025-02-13T05:19:26.643ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bae5c146-02a7-4481-95c4-d17a507c6b7f", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45612025-02-13T05:19:26.643ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45622025-02-13T05:19:26.645ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7bac485c-48ca-41c4-9fcb-3b99a37f12b6", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45632025-02-13T05:19:26.645ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45642025-02-13T05:19:26.646ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a5032ef9-a8f9-477b-87ab-bc0374c6a832", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45652025-02-13T05:19:26.646ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45662025-02-13T05:19:26.648ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
45672025-02-13T05:19:26.648ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45682025-02-13T05:19:26.648ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45692025-02-13T05:19:26.648ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 409.115298ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45702025-02-13T05:19:26.648ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d93a86c-d726-43f1-9ed5-e83618c0ad3d", "content-length": "26", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
45712025-02-13T05:19:26.648ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45722025-02-13T05:19:26.650ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
45732025-02-13T05:19:26.664ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45742025-02-13T05:19:26.664ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45752025-02-13T05:19:26.665ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "aef8244f-7ca4-48b8-a4fe-b4fde9f7175a", "content-length": "585", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
45762025-02-13T05:19:26.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45772025-02-13T05:19:26.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45782025-02-13T05:19:26.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45792025-02-13T05:19:26.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45802025-02-13T05:19:26.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45812025-02-13T05:19:26.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45822025-02-13T05:19:26.745ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {d4e0dc3f-8a80-40b2-beb9-6161c71d002e: {10.151.2.175: {f0a62aa8-3d88-4ee2-9a92-13e8d15b0d11}, 10.151.2.176: {f0a62aa8-3d88-4ee2-9a92-13e8d15b0d11}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45832025-02-13T05:19:26.745ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45842025-02-13T05:19:26.745ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c4027a92-0d63-4d4d-ab75-546418be613d", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
45852025-02-13T05:19:26.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45862025-02-13T05:19:26.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45872025-02-13T05:19:26.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45882025-02-13T05:19:26.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45892025-02-13T05:19:26.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45902025-02-13T05:19:26.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45912025-02-13T05:19:26.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45922025-02-13T05:19:26.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45932025-02-13T05:19:26.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45942025-02-13T05:19:26.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45952025-02-13T05:19:26.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45962025-02-13T05:19:26.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45972025-02-13T05:19:26.767ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45982025-02-13T05:19:26.767ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45992025-02-13T05:19:26.767ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46002025-02-13T05:19:26.768ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "61e18209-6d86-457d-bc30-f6d50f85bd41", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
46012025-02-13T05:19:26.769ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 529.395089ms iteration = 23 status = {}
46022025-02-13T05:19:26.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46032025-02-13T05:19:26.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46042025-02-13T05:19:26.778ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
46052025-02-13T05:19:26.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46062025-02-13T05:19:26.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46072025-02-13T05:19:26.791ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46082025-02-13T05:19:26.791ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "29b208fb-04bb-4e78-9d52-67260840de7c", "content-length": "134", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
46092025-02-13T05:19:26.791ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46102025-02-13T05:19:26.791ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
46112025-02-13T05:19:26.792ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46122025-02-13T05:19:26.792ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46132025-02-13T05:19:26.792ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46142025-02-13T05:19:26.792ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46152025-02-13T05:19:26.792ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46162025-02-13T05:19:26.792ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46172025-02-13T05:19:26.792ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46182025-02-13T05:19:26.792ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46192025-02-13T05:19:26.792ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
46202025-02-13T05:19:26.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46212025-02-13T05:19:26.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46222025-02-13T05:19:26.795ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46232025-02-13T05:19:26.795ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a8fdf10-5b1a-4832-8225-77a6fd02a5a6", "content-length": "2", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
46242025-02-13T05:19:26.795ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46252025-02-13T05:19:26.795ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "03fc0a88-cabc-4b64-81cf-f972a2aeb0cb", "content-length": "52", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
46262025-02-13T05:19:26.795ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
46272025-02-13T05:19:26.795ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46282025-02-13T05:19:26.825ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46292025-02-13T05:19:26.902ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cb4dc876-91a7-4604-9068-8cfd252f3aed", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
46302025-02-13T05:19:26.902ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
46312025-02-13T05:19:26.902ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46322025-02-13T05:19:26.903ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7513c50-83ea-4b66-b4ed-93355be1f114", "content-length": "682", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
46332025-02-13T05:19:26.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46342025-02-13T05:19:26.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46352025-02-13T05:19:26.903ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f368ef9f-11d5-4791-a7b0-3bf3b50ff33c", "content-length": "811", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
46362025-02-13T05:19:26.903ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(16186248) }} sled = sock
46372025-02-13T05:19:26.903ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46382025-02-13T05:19:26.903ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46392025-02-13T05:19:26.904ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 664.502332ms iteration = 23 status = {}
46402025-02-13T05:19:26.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46412025-02-13T05:19:26.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46422025-02-13T05:19:26.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46432025-02-13T05:19:26.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46442025-02-13T05:19:26.912ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46452025-02-13T05:19:26.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46462025-02-13T05:19:26.920ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 681.052712ms iteration = 23 status = {}
46472025-02-13T05:19:27.035ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 783fce27-e546-4e3b-91f5-b68a22c014d6 remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6025c96d-cf9a-482d-980f-f3e3445bb52c uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-13T05:19:27.035548140Z }
46482025-02-13T05:19:27.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6025c96d-cf9a-482d-980f-f3e3445bb52c roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46492025-02-13T05:19:27.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6025c96d-cf9a-482d-980f-f3e3445bb52c resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46502025-02-13T05:19:27.093ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
46512025-02-13T05:19:27.093ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
46522025-02-13T05:19:27.105ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:165 retry_after (ms) = 21 transaction = vmm_and_migration_update_runtime
46532025-02-13T05:19:27.124ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
46542025-02-13T05:19:27.124ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:53176
46552025-02-13T05:19:27.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:53176 req_id = 9a839eec-5fef-4736-86c0-3fcf43c6a165 roles = RoleSet { roles: {} } uri = /metrics/producers
46562025-02-13T05:19:27.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:53176 req_id = 9a839eec-5fef-4736-86c0-3fcf43c6a165 resource = Database result = Ok(()) uri = /metrics/producers
46572025-02-13T05:19:27.137ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:121 transaction = vmm_and_migration_update_runtime
46582025-02-13T05:19:27.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101281 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6025c96d-cf9a-482d-980f-f3e3445bb52c response_code = 204 uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46592025-02-13T05:19:27.165ZINFOnexus: assigned collector to new producer collector_id = 93aa177d-6d80-4ea9-988c-9de41b46fd8d file = nexus/src/app/oximeter.rs:76 producer_id = a8269f60-9104-4275-9edc-a31614d5c23e
46602025-02-13T05:19:27.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40701 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:53176 req_id = 9a839eec-5fef-4736-86c0-3fcf43c6a165 response_code = 201 uri = /metrics/producers
46612025-02-13T05:19:27.165ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9a839eec-5fef-4736-86c0-3fcf43c6a165", "content-length": "41", "date": "Thu, 13 Feb 2025 05:19:26 GMT"} })
46622025-02-13T05:19:27.166ZDEBGnexus (producer-registration-task): registered with nexus successfully
46632025-02-13T05:19:27.166ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
46642025-02-13T05:19:27.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ad18a109-5982-41dc-99c1-31900f65db4b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
46652025-02-13T05:19:27.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ad18a109-5982-41dc-99c1-31900f65db4b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
46662025-02-13T05:19:27.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ad18a109-5982-41dc-99c1-31900f65db4b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
46672025-02-13T05:19:28.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 29251b05-3df2-4b30-a322-ecf293f1e11c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
46682025-02-13T05:19:28.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 29251b05-3df2-4b30-a322-ecf293f1e11c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
46692025-02-13T05:19:28.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 29251b05-3df2-4b30-a322-ecf293f1e11c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
46702025-02-13T05:19:29.578ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 783fce27-e546-4e3b-91f5-b68a22c014d6 remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-13T05:19:29.578298670Z }
46712025-02-13T05:19:29.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46722025-02-13T05:19:29.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46732025-02-13T05:19:29.614ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 783fce27-e546-4e3b-91f5-b68a22c014d6 remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6 vmm_needs_update = true
46742025-02-13T05:19:29.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46752025-02-13T05:19:29.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46762025-02-13T05:19:29.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46772025-02-13T05:19:29.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46782025-02-13T05:19:29.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46792025-02-13T05:19:29.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46802025-02-13T05:19:29.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46812025-02-13T05:19:29.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46822025-02-13T05:19:29.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46832025-02-13T05:19:29.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46842025-02-13T05:19:29.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46852025-02-13T05:19:29.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46862025-02-13T05:19:29.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46872025-02-13T05:19:29.660ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: b8f13615-12e0-4837-bffe-48620fa7aaa2, lookup_type: ById(b8f13615-12e0-4837-bffe-48620fa7aaa2) }, key: 042a7604-b098-4fb4-8331-96be12e3c004, lookup_type: ById(042a7604-b098-4fb4-8331-96be12e3c004) }, key: 57ce81a4-40a7-4278-a40e-b11f33b0a5f4, lookup_type: ById(57ce81a4-40a7-4278-a40e-b11f33b0a5f4) } result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46882025-02-13T05:19:29.672ZINFOnexus (dropshot_internal): starting update saga for 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1545 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-13T05:19:29.578298670Z }
46892025-02-13T05:19:29.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98005 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 response_code = 204 uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46902025-02-13T05:19:29.676ZDEBGnexus (dropshot_internal): preparing instance-update saga for 57ce81a4-40a7-4278-a40e-b11f33b0a5f4... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb4e143d-2179-48d5-a3b8-99f6add7e629 uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46912025-02-13T05:19:29.676ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update
46922025-02-13T05:19:29.676ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 783fce27-e546-4e3b-91f5-b68a22c014d6 remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c430e95d-7208-410f-bb63-c9625fed9d6f uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-13T05:19:29.578298670Z }
46932025-02-13T05:19:29.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c430e95d-7208-410f-bb63-c9625fed9d6f roles = RoleSet { roles: {} } uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46942025-02-13T05:19:29.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c430e95d-7208-410f-bb63-c9625fed9d6f resource = Database result = Ok(()) uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46952025-02-13T05:19:29.678ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"57ce81a4-40a7-4278-a40e-b11f33b0a5f4","lookup_type":{"ById":"57ce81a4-40a7-4278-a40e-b11f33b0a5f4"},"parent":{"key":"042a7604-b098-4fb4-8331-96be12e3c004","lookup_type":{"ById":"042a7604-b098-4fb4-8331-96be12e3c004"},"parent":{"key":"b8f13615-12e0-4837-bffe-48620fa7aaa2","lookup_type":{"ById":"b8f13615-12e0-4837-bffe-48620fa7aaa2"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
46962025-02-13T05:19:29.678ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update
46972025-02-13T05:19:29.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30647 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c430e95d-7208-410f-bb63-c9625fed9d6f response_code = 204 uri = /vmms/783fce27-e546-4e3b-91f5-b68a22c014d6
46982025-02-13T05:19:29.716ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update
46992025-02-13T05:19:29.716ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47002025-02-13T05:19:29.718ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47012025-02-13T05:19:29.718ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
47022025-02-13T05:19:29.723ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47032025-02-13T05:19:29.723ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
47042025-02-13T05:19:29.726ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47052025-02-13T05:19:29.726ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
47062025-02-13T05:19:29.732ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47072025-02-13T05:19:29.732ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c5020fbd-0749-49d1-9df9-77b0c6ebb92b")) node_id = 0 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
47082025-02-13T05:19:29.736ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47092025-02-13T05:19:29.736ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
47102025-02-13T05:19:29.756ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update
47112025-02-13T05:19:29.756ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47122025-02-13T05:19:29.756ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47132025-02-13T05:19:29.758ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47142025-02-13T05:19:29.758ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47152025-02-13T05:19:29.760ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47162025-02-13T05:19:29.760ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47172025-02-13T05:19:29.762ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47182025-02-13T05:19:29.762ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47192025-02-13T05:19:29.764ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47202025-02-13T05:19:29.764ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47212025-02-13T05:19:29.765ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47222025-02-13T05:19:29.765ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47232025-02-13T05:19:29.767ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47242025-02-13T05:19:29.770ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: b8f13615-12e0-4837-bffe-48620fa7aaa2, lookup_type: ById(b8f13615-12e0-4837-bffe-48620fa7aaa2) }, key: 042a7604-b098-4fb4-8331-96be12e3c004, lookup_type: ById(042a7604-b098-4fb4-8331-96be12e3c004) }, key: 57ce81a4-40a7-4278-a40e-b11f33b0a5f4, lookup_type: ById(57ce81a4-40a7-4278-a40e-b11f33b0a5f4) } result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47252025-02-13T05:19:29.772ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance updater_id = c5020fbd-0749-49d1-9df9-77b0c6ebb92b
47262025-02-13T05:19:29.772ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47272025-02-13T05:19:29.772ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47282025-02-13T05:19:29.788ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance updater_id = c5020fbd-0749-49d1-9df9-77b0c6ebb92b
47292025-02-13T05:19:29.788ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47302025-02-13T05:19:29.788ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance
47312025-02-13T05:19:29.793ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 locked_gen = Generation(Generation(2)) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = LockInstance updater_id = c5020fbd-0749-49d1-9df9-77b0c6ebb92b
47322025-02-13T05:19:29.795ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47332025-02-13T05:19:29.795ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("c5020fbd-0749-49d1-9df9-77b0c6ebb92b")}) node_id = 1 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
47342025-02-13T05:19:29.799ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47352025-02-13T05:19:29.799ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
47362025-02-13T05:19:29.808ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47372025-02-13T05:19:29.808ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47382025-02-13T05:19:29.809ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47392025-02-13T05:19:29.809ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47402025-02-13T05:19:29.810ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47412025-02-13T05:19:29.810ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47422025-02-13T05:19:29.812ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47432025-02-13T05:19:29.815ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: b8f13615-12e0-4837-bffe-48620fa7aaa2, lookup_type: ById(b8f13615-12e0-4837-bffe-48620fa7aaa2) }, key: 042a7604-b098-4fb4-8331-96be12e3c004, lookup_type: ById(042a7604-b098-4fb4-8331-96be12e3c004) }, key: 57ce81a4-40a7-4278-a40e-b11f33b0a5f4, lookup_type: ById(57ce81a4-40a7-4278-a40e-b11f33b0a5f4) } result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47442025-02-13T05:19:29.815ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47452025-02-13T05:19:29.815ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47462025-02-13T05:19:29.823ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 783fce27-e546-4e3b-91f5-b68a22c014d6, time_created: 2025-02-13T05:19:06.963029Z, time_deleted: None, instance_id: 57ce81a4-40a7-4278-a40e-b11f33b0a5f4, sled_id: 5835b48f-f45d-4fa8-91ed-38d933d73732, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-02-13T05:19:29.578298Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-02-13T05:19:04.049464Z, gen: Generation(Generation(3)), propolis_id: Some(783fce27-e546-4e3b-91f5-b68a22c014d6), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(783fce27-e546-4e3b-91f5-b68a22c014d6 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-02-13T05:19:29.822963669Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
47472025-02-13T05:19:29.823ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
47482025-02-13T05:19:29.823ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"57ce81a4-40a7-4278-a40e-b11f33b0a5f4","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"783fce27-e546-4e3b-91f5-b68a22c014d6"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"57ce81a4-40a7-4278-a40e-b11f33b0a5f4","lookup_type":{"ById":"57ce81a4-40a7-4278-a40e-b11f33b0a5f4"},"parent":{"key":"042a7604-b098-4fb4-8331-96be12e3c004","lookup_type":{"ById":"042a7604-b098-4fb4-8331-96be12e3c004"},"parent":{"key":"b8f13615-12e0-4837-bffe-48620fa7aaa2","lookup_type":{"ById":"b8f13615-12e0-4837-bffe-48620fa7aaa2"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"c5020fbd-0749-49d1-9df9-77b0c6ebb92b"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"042a7604-b098-4fb4-8331-96be12e3c004","ram_diff":1073741824},"destroy_active_vmm":"783fce27-e546-4e3b-91f5-b68a22c014d6","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-02-13T05:19:29.822963669Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47492025-02-13T05:19:29.823ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
47502025-02-13T05:19:29.827ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
47512025-02-13T05:19:29.827ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47522025-02-13T05:19:29.827ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47532025-02-13T05:19:29.827ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
47542025-02-13T05:19:29.831ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47552025-02-13T05:19:29.831ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
47562025-02-13T05:19:29.835ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47572025-02-13T05:19:29.835ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
47582025-02-13T05:19:29.839ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47592025-02-13T05:19:29.839ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("906c7ea9-5cc6-4997-91ec-fa048763310e")) node_id = 0 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
47602025-02-13T05:19:29.842ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47612025-02-13T05:19:29.842ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
47622025-02-13T05:19:29.848ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 parent_lock = UpdaterLock { updater_id: c5020fbd-0749-49d1-9df9-77b0c6ebb92b, locked_gen: Generation(Generation(2)) } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
47632025-02-13T05:19:29.848ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = BecomeUpdater
47642025-02-13T05:19:29.848ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = BecomeUpdater
47652025-02-13T05:19:29.860ZDEBGnexus (SagaExecutor): inherited lock from c5020fbd-0749-49d1-9df9-77b0c6ebb92b to 906c7ea9-5cc6-4997-91ec-fa048763310e actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = c5020fbd-0749-49d1-9df9-77b0c6ebb92b saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = BecomeUpdater updater_id = 906c7ea9-5cc6-4997-91ec-fa048763310e
47662025-02-13T05:19:29.860ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
47672025-02-13T05:19:29.860ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47682025-02-13T05:19:29.860ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("906c7ea9-5cc6-4997-91ec-fa048763310e")}) node_id = 1 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
47692025-02-13T05:19:29.864ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47702025-02-13T05:19:29.864ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
47712025-02-13T05:19:29.867ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47722025-02-13T05:19:29.867ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
47732025-02-13T05:19:29.870ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
47742025-02-13T05:19:29.870ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
47752025-02-13T05:19:29.876ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
47762025-02-13T05:19:29.876ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4
47772025-02-13T05:19:29.880ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = UpdateNetworkConfig
47782025-02-13T05:19:29.880ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = UpdateNetworkConfig
47792025-02-13T05:19:29.884ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = UpdateNetworkConfig
47802025-02-13T05:19:29.884ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = UpdateNetworkConfig
47812025-02-13T05:19:29.893ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
47822025-02-13T05:19:29.893ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = UpdateNetworkConfig
47832025-02-13T05:19:29.893ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = UpdateNetworkConfig
47842025-02-13T05:19:29.896ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
47852025-02-13T05:19:29.896ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
47862025-02-13T05:19:29.896ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
47872025-02-13T05:19:29.897ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
47882025-02-13T05:19:29.899ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
47892025-02-13T05:19:29.899ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
47902025-02-13T05:19:29.899ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
47912025-02-13T05:19:29.905ZDEBGnexus: notifying dendrite of updates instance_id = Some(57ce81a4-40a7-4278-a40e-b11f33b0a5f4 (instance)) switch = switch0
47922025-02-13T05:19:29.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1479, tv_nsec: 446490134 } })
47932025-02-13T05:19:29.906ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1154
47942025-02-13T05:19:29.937ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
47952025-02-13T05:19:29.937ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47962025-02-13T05:19:29.937ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "353650dd-9975-4bef-ad81-9fe1195a5025", "content-length": "26", "date": "Thu, 13 Feb 2025 05:19:29 GMT"} })
47972025-02-13T05:19:29.937ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47982025-02-13T05:19:29.938ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47992025-02-13T05:19:29.967ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
48002025-02-13T05:19:29.967ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "a72870b1-238f-41dc-a9fb-68bf8f37b5e0", "content-length": "4", "date": "Thu, 13 Feb 2025 05:19:29 GMT"} })
48012025-02-13T05:19:29.970ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48022025-02-13T05:19:29.970ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48032025-02-13T05:19:29.974ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48042025-02-13T05:19:29.974ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48052025-02-13T05:19:29.980ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
48062025-02-13T05:19:29.981ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
48072025-02-13T05:19:29.992ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-02-13T05:19:29.983822Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 042a7604-b098-4fb4-8331-96be12e3c004, time_modified: Some(2025-02-13T05:19:29.983822Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, time_modified: Some(2025-02-13T05:19:29.983822Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
48082025-02-13T05:19:29.992ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48092025-02-13T05:19:29.992ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48102025-02-13T05:19:29.996ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48112025-02-13T05:19:29.996ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48122025-02-13T05:19:30.002ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
48132025-02-13T05:19:30.002ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = UnassignOximeterProducer
48142025-02-13T05:19:30.002ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = UnassignOximeterProducer
48152025-02-13T05:19:30.007ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 93aa177d-6d80-4ea9-988c-9de41b46fd8d producer_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
48162025-02-13T05:19:30.007ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = UnassignOximeterProducer
48172025-02-13T05:19:30.007ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = UnassignOximeterProducer
48182025-02-13T05:19:30.042ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
48192025-02-13T05:19:30.042ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/57ce81a4-40a7-4278-a40e-b11f33b0a5f4
48202025-02-13T05:19:30.059ZDEBGnexus (SagaExecutor): client response oximeter-collector = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/57ce81a4-40a7-4278-a40e-b11f33b0a5f4", status: 204, headers: {"x-request-id": "bec81726-1873-46e6-9da9-55fce58de57e", "date": "Thu, 13 Feb 2025 05:19:30 GMT"} }) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
48212025-02-13T05:19:30.059ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 93aa177d-6d80-4ea9-988c-9de41b46fd8d producer_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
48222025-02-13T05:19:30.061ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48232025-02-13T05:19:30.061ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48242025-02-13T05:19:30.065ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48252025-02-13T05:19:30.065ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48262025-02-13T05:19:30.069ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 lock = UpdaterLock { updater_id: 906c7ea9-5cc6-4997-91ec-fa048763310e, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-02-13T05:19:29.822963669Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
48272025-02-13T05:19:30.069ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = CommitInstanceUpdates
48282025-02-13T05:19:30.069ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = CommitInstanceUpdates
48292025-02-13T05:19:30.110ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 new_runtime = InstanceRuntimeState { time_updated: 2025-02-13T05:19:29.822963669Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
48302025-02-13T05:19:30.110ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48312025-02-13T05:19:30.110ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48322025-02-13T05:19:30.110ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
48332025-02-13T05:19:30.110ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48342025-02-13T05:19:30.110ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
48352025-02-13T05:19:30.110ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48362025-02-13T05:19:30.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48372025-02-13T05:19:30.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48382025-02-13T05:19:30.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48392025-02-13T05:19:30.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48402025-02-13T05:19:30.114ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48412025-02-13T05:19:30.114ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48422025-02-13T05:19:30.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48432025-02-13T05:19:30.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48442025-02-13T05:19:30.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48452025-02-13T05:19:30.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48462025-02-13T05:19:30.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48472025-02-13T05:19:30.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48482025-02-13T05:19:30.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48492025-02-13T05:19:30.119ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48502025-02-13T05:19:30.119ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("57ce81a4-40a7-4278-a40e-b11f33b0a5f4"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("783fce27-e546-4e3b-91f5-b68a22c014d6")}) node_id = 7 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48512025-02-13T05:19:30.123ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48522025-02-13T05:19:30.123ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48532025-02-13T05:19:30.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48542025-02-13T05:19:30.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48552025-02-13T05:19:30.128ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48562025-02-13T05:19:30.128ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48572025-02-13T05:19:30.133ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48582025-02-13T05:19:30.133ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48592025-02-13T05:19:30.136ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 propolis_id = 783fce27-e546-4e3b-91f5-b68a22c014d6 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
48602025-02-13T05:19:30.136ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ReleaseSledResources
48612025-02-13T05:19:30.137ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ReleaseSledResources
48622025-02-13T05:19:30.152ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48632025-02-13T05:19:30.152ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48642025-02-13T05:19:30.156ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48652025-02-13T05:19:30.156ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48662025-02-13T05:19:30.160ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 propolis_id = 783fce27-e546-4e3b-91f5-b68a22c014d6 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
48672025-02-13T05:19:30.160ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = MarkVmmDeleted
48682025-02-13T05:19:30.160ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = MarkVmmDeleted
48692025-02-13T05:19:30.164ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2881 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 29949b9e-7355-4ff5-9ff4-9466e5416b83 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
48702025-02-13T05:19:30.169ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48712025-02-13T05:19:30.169ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48722025-02-13T05:19:30.173ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48732025-02-13T05:19:30.173ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48742025-02-13T05:19:30.177ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48752025-02-13T05:19:30.177ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48762025-02-13T05:19:30.181ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
48772025-02-13T05:19:30.181ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
48782025-02-13T05:19:30.184ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ChainSuccessorSaga
48792025-02-13T05:19:30.185ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ChainSuccessorSaga
48802025-02-13T05:19:30.209ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48812025-02-13T05:19:30.209ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48822025-02-13T05:19:30.210ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "41ea2594-3dac-44ad-9e5c-213d66314e2d", "content-length": "372", "date": "Thu, 13 Feb 2025 05:19:30 GMT"} })
48832025-02-13T05:19:30.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48842025-02-13T05:19:30.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48852025-02-13T05:19:30.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48862025-02-13T05:19:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48872025-02-13T05:19:30.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48882025-02-13T05:19:30.228ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48892025-02-13T05:19:30.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48902025-02-13T05:19:30.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48912025-02-13T05:19:30.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48922025-02-13T05:19:30.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48932025-02-13T05:19:30.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48942025-02-13T05:19:30.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48952025-02-13T05:19:30.246ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ChainSuccessorSaga
48962025-02-13T05:19:30.246ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ChainSuccessorSaga
48972025-02-13T05:19:30.248ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ChainSuccessorSaga
48982025-02-13T05:19:30.248ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ChainSuccessorSaga
48992025-02-13T05:19:30.254ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
49002025-02-13T05:19:30.254ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49012025-02-13T05:19:30.255ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7fee19ee-6339-4028-9179-0e1ac0d4c65f", "date": "Thu, 13 Feb 2025 05:19:30 GMT"} })
49022025-02-13T05:19:30.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49032025-02-13T05:19:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49042025-02-13T05:19:30.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49052025-02-13T05:19:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49062025-02-13T05:19:30.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49072025-02-13T05:19:30.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49082025-02-13T05:19:30.265ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49092025-02-13T05:19:30.265ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5f5c1a0-7bd5-4041-819e-869cd09e7cab", "content-length": "691", "date": "Thu, 13 Feb 2025 05:19:30 GMT"} })
49102025-02-13T05:19:30.265ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
49112025-02-13T05:19:30.265ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
49122025-02-13T05:19:30.265ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
49132025-02-13T05:19:30.266ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 155.588816ms iteration = 24 status = {}
49142025-02-13T05:19:30.268ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49152025-02-13T05:19:30.268ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49162025-02-13T05:19:30.268ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d317dbdd-a4c7-4276-8ab5-18847c635aea", "date": "Thu, 13 Feb 2025 05:19:30 GMT"} })
49172025-02-13T05:19:30.270ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 159.506127ms iteration = 24 status = {}
49182025-02-13T05:19:30.275ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ChainSuccessorSaga
49192025-02-13T05:19:30.278ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: b8f13615-12e0-4837-bffe-48620fa7aaa2, lookup_type: ById(b8f13615-12e0-4837-bffe-48620fa7aaa2) }, key: 042a7604-b098-4fb4-8331-96be12e3c004, lookup_type: ById(042a7604-b098-4fb4-8331-96be12e3c004) }, key: 57ce81a4-40a7-4278-a40e-b11f33b0a5f4, lookup_type: ById(57ce81a4-40a7-4278-a40e-b11f33b0a5f4) } result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ChainSuccessorSaga
49202025-02-13T05:19:30.278ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ChainSuccessorSaga
49212025-02-13T05:19:30.278ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_node = ChainSuccessorSaga
49222025-02-13T05:19:30.283ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update
49232025-02-13T05:19:30.283ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
49242025-02-13T05:19:30.283ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
49252025-02-13T05:19:30.287ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
49262025-02-13T05:19:30.287ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
49272025-02-13T05:19:30.291ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
49282025-02-13T05:19:30.291ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
49292025-02-13T05:19:30.294ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
49302025-02-13T05:19:30.294ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273
49312025-02-13T05:19:30.304ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
49322025-02-13T05:19:30.304ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 saga_name = instance-update saga_result = SagaResult { saga_id: 3be67b64-5a09-4c41-acb8-0382a382b273, saga_log: SagaLog { saga_id: 3be67b64-5a09-4c41-acb8-0382a382b273, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("906c7ea9-5cc6-4997-91ec-fa048763310e")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("906c7ea9-5cc6-4997-91ec-fa048763310e")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("57ce81a4-40a7-4278-a40e-b11f33b0a5f4"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("783fce27-e546-4e3b-91f5-b68a22c014d6")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("57ce81a4-40a7-4278-a40e-b11f33b0a5f4"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("783fce27-e546-4e3b-91f5-b68a22c014d6")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("906c7ea9-5cc6-4997-91ec-fa048763310e"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("906c7ea9-5cc6-4997-91ec-fa048763310e")}} }) }
49332025-02-13T05:19:30.304ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 3be67b64-5a09-4c41-acb8-0382a382b273 instance_id = 57ce81a4-40a7-4278-a40e-b11f33b0a5f4 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update
49342025-02-13T05:19:30.304ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
49352025-02-13T05:19:30.304ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
49362025-02-13T05:19:30.307ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
49372025-02-13T05:19:30.307ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
49382025-02-13T05:19:30.311ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
49392025-02-13T05:19:30.311ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
49402025-02-13T05:19:30.315ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
49412025-02-13T05:19:30.315ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04
49422025-02-13T05:19:30.350ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update sec_id = a8269f60-9104-4275-9edc-a31614d5c23e
49432025-02-13T05:19:30.350ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 7460e811-0372-42e9-9cab-26e2d246eb04 saga_name = start-instance-update saga_result = SagaResult { saga_id: 7460e811-0372-42e9-9cab-26e2d246eb04, saga_log: SagaLog { saga_id: 7460e811-0372-42e9-9cab-26e2d246eb04, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("c5020fbd-0749-49d1-9df9-77b0c6ebb92b")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("c5020fbd-0749-49d1-9df9-77b0c6ebb92b")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("c5020fbd-0749-49d1-9df9-77b0c6ebb92b"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("c5020fbd-0749-49d1-9df9-77b0c6ebb92b")}} }) }
49442025-02-13T05:19:30.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96bc8540-5221-49ed-9aa5-472875604e0d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49452025-02-13T05:19:30.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96bc8540-5221-49ed-9aa5-472875604e0d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49462025-02-13T05:19:30.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96bc8540-5221-49ed-9aa5-472875604e0d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49472025-02-13T05:19:31.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9ffaea49-64fd-4da7-86c0-4e2c2193277a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49482025-02-13T05:19:31.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9ffaea49-64fd-4da7-86c0-4e2c2193277a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49492025-02-13T05:19:31.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9ffaea49-64fd-4da7-86c0-4e2c2193277a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49502025-02-13T05:19:32.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e9063218-1f3d-4f32-9d83-07e900eaa7a5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49512025-02-13T05:19:32.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e9063218-1f3d-4f32-9d83-07e900eaa7a5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49522025-02-13T05:19:32.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e9063218-1f3d-4f32-9d83-07e900eaa7a5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49532025-02-13T05:19:33.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d9219a49-6204-4d18-9243-f0bd1e0c6888 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49542025-02-13T05:19:33.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d9219a49-6204-4d18-9243-f0bd1e0c6888 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49552025-02-13T05:19:33.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d9219a49-6204-4d18-9243-f0bd1e0c6888 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49562025-02-13T05:19:34.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b8b7ea19-91fb-4748-9095-3f13a62a5f03 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49572025-02-13T05:19:34.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b8b7ea19-91fb-4748-9095-3f13a62a5f03 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49582025-02-13T05:19:34.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2998 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b8b7ea19-91fb-4748-9095-3f13a62a5f03 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49592025-02-13T05:19:35.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4d4a5fe0-af29-47cc-aabf-17d6cbadd170 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49602025-02-13T05:19:35.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4d4a5fe0-af29-47cc-aabf-17d6cbadd170 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49612025-02-13T05:19:35.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4d4a5fe0-af29-47cc-aabf-17d6cbadd170 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49622025-02-13T05:19:36.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
49632025-02-13T05:19:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
49642025-02-13T05:19:36.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49652025-02-13T05:19:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49662025-02-13T05:19:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49672025-02-13T05:19:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49682025-02-13T05:19:36.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49692025-02-13T05:19:36.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49702025-02-13T05:19:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49712025-02-13T05:19:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49722025-02-13T05:19:36.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49732025-02-13T05:19:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49742025-02-13T05:19:36.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49752025-02-13T05:19:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49762025-02-13T05:19:36.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49772025-02-13T05:19:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
49782025-02-13T05:19:36.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49792025-02-13T05:19:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49802025-02-13T05:19:36.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
49812025-02-13T05:19:36.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.966598ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
49822025-02-13T05:19:36.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.512687ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49832025-02-13T05:19:36.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f5a8408c-d1a5-42c6-a5e3-a0e5e031a763 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49842025-02-13T05:19:36.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f5a8408c-d1a5-42c6-a5e3-a0e5e031a763 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49852025-02-13T05:19:36.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1848 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f5a8408c-d1a5-42c6-a5e3-a0e5e031a763 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49862025-02-13T05:19:37.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e6fe8ba8-9a1a-4dde-9d23-5b4e578176ae roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49872025-02-13T05:19:37.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e6fe8ba8-9a1a-4dde-9d23-5b4e578176ae resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49882025-02-13T05:19:37.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e6fe8ba8-9a1a-4dde-9d23-5b4e578176ae response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49892025-02-13T05:19:38.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 324fde85-7e28-417f-b40c-99d5cdb0fa72 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49902025-02-13T05:19:38.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 324fde85-7e28-417f-b40c-99d5cdb0fa72 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49912025-02-13T05:19:38.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2654 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 324fde85-7e28-417f-b40c-99d5cdb0fa72 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49922025-02-13T05:19:39.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ec7c74b8-8b72-4c94-891f-fa62e587f232 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49932025-02-13T05:19:39.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ec7c74b8-8b72-4c94-891f-fa62e587f232 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49942025-02-13T05:19:39.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ec7c74b8-8b72-4c94-891f-fa62e587f232 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
49952025-02-13T05:19:40.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a933d39d-efa6-4967-ac75-537c9cc43e1f roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
49962025-02-13T05:19:40.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a933d39d-efa6-4967-ac75-537c9cc43e1f resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
49972025-02-13T05:19:40.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3490 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a933d39d-efa6-4967-ac75-537c9cc43e1f response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
49982025-02-13T05:19:40.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 8641b160-33d5-4572-8d9e-2738d51bfa7b roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
49992025-02-13T05:19:40.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 8641b160-33d5-4572-8d9e-2738d51bfa7b resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
50002025-02-13T05:19:40.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 8641b160-33d5-4572-8d9e-2738d51bfa7b response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
50012025-02-13T05:19:40.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 428 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 1fa48214-1b0c-485e-8a4c-414fcf22cdea response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
50022025-02-13T05:19:40.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1ddb1344-f4be-4522-8fb5-e591523d08d0 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50032025-02-13T05:19:40.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1ddb1344-f4be-4522-8fb5-e591523d08d0 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50042025-02-13T05:19:40.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1ddb1344-f4be-4522-8fb5-e591523d08d0 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50052025-02-13T05:19:41.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 25f93b89-22a1-4e23-ad9e-e6de949fcafb roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50062025-02-13T05:19:41.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 25f93b89-22a1-4e23-ad9e-e6de949fcafb resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50072025-02-13T05:19:41.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 25f93b89-22a1-4e23-ad9e-e6de949fcafb response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50082025-02-13T05:19:42.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9f588323-f4b8-4211-9fe5-38ef78270c11 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50092025-02-13T05:19:42.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9f588323-f4b8-4211-9fe5-38ef78270c11 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50102025-02-13T05:19:42.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9f588323-f4b8-4211-9fe5-38ef78270c11 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50112025-02-13T05:19:43.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5c89ee7d-1f31-4f8b-b9ca-7ff080e49e73 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50122025-02-13T05:19:43.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5c89ee7d-1f31-4f8b-b9ca-7ff080e49e73 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50132025-02-13T05:19:43.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5c89ee7d-1f31-4f8b-b9ca-7ff080e49e73 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50142025-02-13T05:19:44.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 27965ec9-6029-46df-8a76-0b168dd698fb roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50152025-02-13T05:19:44.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 27965ec9-6029-46df-8a76-0b168dd698fb resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50162025-02-13T05:19:44.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1891 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 27965ec9-6029-46df-8a76-0b168dd698fb response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50172025-02-13T05:19:46.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b3801d53-66c9-42f1-931c-0f7edab024af roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50182025-02-13T05:19:46.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b3801d53-66c9-42f1-931c-0f7edab024af resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50192025-02-13T05:19:46.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b3801d53-66c9-42f1-931c-0f7edab024af response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50202025-02-13T05:19:46.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
50212025-02-13T05:19:46.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
50222025-02-13T05:19:46.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50232025-02-13T05:19:46.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50242025-02-13T05:19:46.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50252025-02-13T05:19:46.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50262025-02-13T05:19:46.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50272025-02-13T05:19:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50282025-02-13T05:19:46.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50292025-02-13T05:19:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50302025-02-13T05:19:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50312025-02-13T05:19:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50322025-02-13T05:19:46.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50332025-02-13T05:19:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
50342025-02-13T05:19:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50352025-02-13T05:19:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50362025-02-13T05:19:46.260ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
50372025-02-13T05:19:46.260ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.699178ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
50382025-02-13T05:19:46.269ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50392025-02-13T05:19:46.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50402025-02-13T05:19:46.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.038918ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50412025-02-13T05:19:47.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 80948f69-44b4-437a-931a-7cd4a31c5504 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50422025-02-13T05:19:47.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 80948f69-44b4-437a-931a-7cd4a31c5504 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50432025-02-13T05:19:47.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 80948f69-44b4-437a-931a-7cd4a31c5504 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50442025-02-13T05:19:48.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e5ffba8c-67b6-4d50-bf01-488b311d4abd roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50452025-02-13T05:19:48.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e5ffba8c-67b6-4d50-bf01-488b311d4abd resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50462025-02-13T05:19:48.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e5ffba8c-67b6-4d50-bf01-488b311d4abd response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50472025-02-13T05:19:49.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0bb1ea50-19d2-49d2-a20d-6a71bf752cf0 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50482025-02-13T05:19:49.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0bb1ea50-19d2-49d2-a20d-6a71bf752cf0 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50492025-02-13T05:19:49.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0bb1ea50-19d2-49d2-a20d-6a71bf752cf0 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50502025-02-13T05:19:50.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b77ba38d-b3d8-4484-9548-7bc9484873ba roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50512025-02-13T05:19:50.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b77ba38d-b3d8-4484-9548-7bc9484873ba resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50522025-02-13T05:19:50.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b77ba38d-b3d8-4484-9548-7bc9484873ba response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50532025-02-13T05:19:50.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 728 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 48dae362-8436-42c0-88ad-28720792afb3 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
50542025-02-13T05:19:51.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 84e92976-f3f3-475d-9af6-6216382bee3c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50552025-02-13T05:19:51.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 84e92976-f3f3-475d-9af6-6216382bee3c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50562025-02-13T05:19:51.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 84e92976-f3f3-475d-9af6-6216382bee3c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50572025-02-13T05:19:52.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f91bba53-1ac2-493d-88e0-f24a7a064eb9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50582025-02-13T05:19:52.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f91bba53-1ac2-493d-88e0-f24a7a064eb9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50592025-02-13T05:19:52.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f91bba53-1ac2-493d-88e0-f24a7a064eb9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50602025-02-13T05:19:53.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e3f8c563-4f64-4e7e-8d7a-e21485d6a34e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50612025-02-13T05:19:53.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e3f8c563-4f64-4e7e-8d7a-e21485d6a34e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50622025-02-13T05:19:53.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2334 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e3f8c563-4f64-4e7e-8d7a-e21485d6a34e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50632025-02-13T05:19:54.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 36cd0f8b-29a8-4619-977f-a04f86313ef4 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50642025-02-13T05:19:54.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 36cd0f8b-29a8-4619-977f-a04f86313ef4 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50652025-02-13T05:19:54.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1896 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 36cd0f8b-29a8-4619-977f-a04f86313ef4 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50662025-02-13T05:19:55.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 8be33c5d-96a4-4112-be3a-6f220f99e1b5 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
50672025-02-13T05:19:55.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 8be33c5d-96a4-4112-be3a-6f220f99e1b5 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
50682025-02-13T05:19:55.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3421 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 8be33c5d-96a4-4112-be3a-6f220f99e1b5 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
50692025-02-13T05:19:55.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 4027f60f-2fb8-4ccf-951f-d514e52fecd2 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
50702025-02-13T05:19:55.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 4027f60f-2fb8-4ccf-951f-d514e52fecd2 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
50712025-02-13T05:19:55.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2481 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 4027f60f-2fb8-4ccf-951f-d514e52fecd2 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
50722025-02-13T05:19:55.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f10c36d8-d38a-4fe5-b692-5a230eec6155 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50732025-02-13T05:19:55.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f10c36d8-d38a-4fe5-b692-5a230eec6155 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50742025-02-13T05:19:55.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f10c36d8-d38a-4fe5-b692-5a230eec6155 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50752025-02-13T05:19:56.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c752ba22-d7f6-4f2c-88f0-6ffb0677cfd1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50762025-02-13T05:19:56.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c752ba22-d7f6-4f2c-88f0-6ffb0677cfd1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50772025-02-13T05:19:56.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c752ba22-d7f6-4f2c-88f0-6ffb0677cfd1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
50782025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
50792025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
50802025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
50812025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50822025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
50832025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50842025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
50852025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50862025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
50872025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50882025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
50892025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50902025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
50912025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50922025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
50932025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50942025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
50952025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50962025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
50972025-02-13T05:19:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
50982025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50992025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
51002025-02-13T05:19:56.240ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
51012025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
51022025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51032025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51042025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
51052025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51062025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
51072025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51082025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
51092025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
51102025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51112025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51122025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
51132025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51142025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
51152025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51162025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51172025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51182025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51192025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51202025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51212025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51222025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51232025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51242025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51252025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51262025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51272025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51282025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
51292025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51302025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51312025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51322025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51332025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51342025-02-13T05:19:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51352025-02-13T05:19:56.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51362025-02-13T05:19:56.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51372025-02-13T05:19:56.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.017664ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51382025-02-13T05:19:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51392025-02-13T05:19:56.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51402025-02-13T05:19:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51412025-02-13T05:19:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51422025-02-13T05:19:56.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51432025-02-13T05:19:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51442025-02-13T05:19:56.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51452025-02-13T05:19:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51462025-02-13T05:19:56.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51472025-02-13T05:19:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51482025-02-13T05:19:56.249ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51492025-02-13T05:19:56.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51502025-02-13T05:19:56.253ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51512025-02-13T05:19:56.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51522025-02-13T05:19:56.259ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51532025-02-13T05:19:56.259ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51542025-02-13T05:19:56.259ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51552025-02-13T05:19:56.259ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 799884196 } })
51562025-02-13T05:19:56.259ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 800113233 } })
51572025-02-13T05:19:56.259ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
51582025-02-13T05:19:56.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51592025-02-13T05:19:56.260ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
51602025-02-13T05:19:56.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51612025-02-13T05:19:56.260ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 801361328 } })
51622025-02-13T05:19:56.261ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
51632025-02-13T05:19:56.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51642025-02-13T05:19:56.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51652025-02-13T05:19:56.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51662025-02-13T05:19:56.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51672025-02-13T05:19:56.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51682025-02-13T05:19:56.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.800056ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
51692025-02-13T05:19:56.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.95024ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
51702025-02-13T05:19:56.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51712025-02-13T05:19:56.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51722025-02-13T05:19:56.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51732025-02-13T05:19:56.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51742025-02-13T05:19:56.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51752025-02-13T05:19:56.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51762025-02-13T05:19:56.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.135417ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51772025-02-13T05:19:56.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51782025-02-13T05:19:56.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51792025-02-13T05:19:56.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51802025-02-13T05:19:56.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51812025-02-13T05:19:56.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51822025-02-13T05:19:56.317ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51832025-02-13T05:19:56.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51842025-02-13T05:19:56.318ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51852025-02-13T05:19:56.319ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51862025-02-13T05:19:56.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51872025-02-13T05:19:56.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51882025-02-13T05:19:56.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51892025-02-13T05:19:56.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51902025-02-13T05:19:56.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51912025-02-13T05:19:56.320ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51922025-02-13T05:19:56.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51932025-02-13T05:19:56.322ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 82.359253ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51942025-02-13T05:19:56.322ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51952025-02-13T05:19:56.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51962025-02-13T05:19:56.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51972025-02-13T05:19:56.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51982025-02-13T05:19:56.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51992025-02-13T05:19:56.324ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 84.855354ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
52002025-02-13T05:19:56.325ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52012025-02-13T05:19:56.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52022025-02-13T05:19:56.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52032025-02-13T05:19:56.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52042025-02-13T05:19:56.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52052025-02-13T05:19:56.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52062025-02-13T05:19:56.328ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52072025-02-13T05:19:56.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52082025-02-13T05:19:56.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52092025-02-13T05:19:56.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
52102025-02-13T05:19:56.330ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52112025-02-13T05:19:56.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52122025-02-13T05:19:56.331ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52132025-02-13T05:19:56.331ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52142025-02-13T05:19:56.331ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52152025-02-13T05:19:56.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52162025-02-13T05:19:56.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
52172025-02-13T05:19:56.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52182025-02-13T05:19:56.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52192025-02-13T05:19:56.333ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.765338ms iteration = 24 status = 0
52202025-02-13T05:19:56.338ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52212025-02-13T05:19:56.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52222025-02-13T05:19:56.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52232025-02-13T05:19:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52242025-02-13T05:19:56.363ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
52252025-02-13T05:19:56.363ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52262025-02-13T05:19:56.363ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81f4e18d-6b27-484b-8c1a-2fd2d3f758cb", "content-length": "26", "date": "Thu, 13 Feb 2025 05:19:56 GMT"} })
52272025-02-13T05:19:56.364ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52282025-02-13T05:19:56.366ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
52292025-02-13T05:19:56.366ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52302025-02-13T05:19:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
52312025-02-13T05:19:56.368ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52322025-02-13T05:19:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52332025-02-13T05:19:56.370ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52342025-02-13T05:19:56.370ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 130.294076ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
52352025-02-13T05:19:56.373ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 133.764795ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52362025-02-13T05:19:56.467ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
52372025-02-13T05:19:56.467ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52382025-02-13T05:19:56.468ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4562db35-4832-4772-ab36-28b777c17866", "content-length": "26", "date": "Thu, 13 Feb 2025 05:19:56 GMT"} })
52392025-02-13T05:19:56.468ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52402025-02-13T05:19:56.470ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52412025-02-13T05:19:56.475ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 235.54086ms iteration = 26 status = {"physical_disks_added":0}
52422025-02-13T05:19:56.475ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52432025-02-13T05:19:56.475ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52442025-02-13T05:19:56.476ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "70ec3f58-d571-40bd-bba1-4b814c7211f1", "content-length": "372", "date": "Thu, 13 Feb 2025 05:19:56 GMT"} })
52452025-02-13T05:19:56.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52462025-02-13T05:19:56.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52472025-02-13T05:19:56.491ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
52482025-02-13T05:19:56.491ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52492025-02-13T05:19:56.492ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b582c71c-6525-4c75-8b74-478e434ef436", "content-length": "26", "date": "Thu, 13 Feb 2025 05:19:56 GMT"} })
52502025-02-13T05:19:56.492ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52512025-02-13T05:19:56.492ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
52522025-02-13T05:19:56.492ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 252.937725ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
52532025-02-13T05:19:56.495ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52542025-02-13T05:19:56.517ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
52552025-02-13T05:19:56.517ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 277.40087ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
52562025-02-13T05:19:56.522ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 282.922238ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
52572025-02-13T05:19:56.527ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52582025-02-13T05:19:56.527ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52592025-02-13T05:19:56.527ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 287.93436ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52602025-02-13T05:19:56.540ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
52612025-02-13T05:19:56.540ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52622025-02-13T05:19:56.540ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "10819a33-a5a7-4811-a572-43eca11ed82d", "date": "Thu, 13 Feb 2025 05:19:56 GMT"} })
52632025-02-13T05:19:56.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52642025-02-13T05:19:56.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52652025-02-13T05:19:56.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52662025-02-13T05:19:56.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52672025-02-13T05:19:56.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52682025-02-13T05:19:56.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52692025-02-13T05:19:56.551ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52702025-02-13T05:19:56.552ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52712025-02-13T05:19:56.552ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d13e2212-46b8-4344-b8f7-5ac4d4a659db", "date": "Thu, 13 Feb 2025 05:19:56 GMT"} })
52722025-02-13T05:19:56.554ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 314.915517ms iteration = 25 status = {}
52732025-02-13T05:19:56.559ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 319.006984ms iteration = 24 status = {}
52742025-02-13T05:19:56.570ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52752025-02-13T05:19:56.571ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc9bdc88-be65-478c-9983-e8c17c91eb9c", "content-length": "2", "date": "Thu, 13 Feb 2025 05:19:55 GMT"} })
52762025-02-13T05:19:56.573ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52772025-02-13T05:19:56.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52782025-02-13T05:19:56.575ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 335.656248ms iteration = 24 status = null
52792025-02-13T05:19:56.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52802025-02-13T05:19:56.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52812025-02-13T05:19:56.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52822025-02-13T05:19:56.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52832025-02-13T05:19:56.610ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
52842025-02-13T05:19:56.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52852025-02-13T05:19:56.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52862025-02-13T05:19:56.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52872025-02-13T05:19:56.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52882025-02-13T05:19:56.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52892025-02-13T05:19:56.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52902025-02-13T05:19:56.621ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52912025-02-13T05:19:56.622ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ca444dc-8161-4ab8-b6c9-8f09a3e35015", "content-length": "134", "date": "Thu, 13 Feb 2025 05:19:55 GMT"} })
52922025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52932025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
52942025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52952025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52962025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52972025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52982025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52992025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53002025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53012025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53022025-02-13T05:19:56.622ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
53032025-02-13T05:19:56.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53042025-02-13T05:19:56.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53052025-02-13T05:19:56.625ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53062025-02-13T05:19:56.625ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fb869c4-574d-4621-840b-09e9c196878a", "content-length": "2", "date": "Thu, 13 Feb 2025 05:19:55 GMT"} })
53072025-02-13T05:19:56.625ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53082025-02-13T05:19:56.625ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3163a86-dd1f-4823-a7fd-4f57f19d4e55", "content-length": "52", "date": "Thu, 13 Feb 2025 05:19:55 GMT"} })
53092025-02-13T05:19:56.625ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
53102025-02-13T05:19:56.625ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53112025-02-13T05:19:56.648ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53122025-02-13T05:19:56.650ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53132025-02-13T05:19:56.650ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53142025-02-13T05:19:56.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53152025-02-13T05:19:56.684ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53162025-02-13T05:19:56.706ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1ddaa6d-8ad5-4d04-9303-d97cec057f09", "content-length": "691", "date": "Thu, 13 Feb 2025 05:19:56 GMT"} })
53172025-02-13T05:19:56.706ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
53182025-02-13T05:19:56.706ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
53192025-02-13T05:19:56.706ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
53202025-02-13T05:19:56.707ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 467.963642ms iteration = 25 status = {}
53212025-02-13T05:19:56.896ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "408013d2-0481-4073-90ea-fcc334c6f168", "date": "Thu, 13 Feb 2025 05:19:56 GMT"} })
53222025-02-13T05:19:56.896ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
53232025-02-13T05:19:56.896ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53242025-02-13T05:19:56.896ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ffdf607-ff45-4b83-8e79-e351b535b3df", "content-length": "682", "date": "Thu, 13 Feb 2025 05:19:56 GMT"} })
53252025-02-13T05:19:56.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53262025-02-13T05:19:56.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53272025-02-13T05:19:56.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53282025-02-13T05:19:56.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53292025-02-13T05:19:56.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53302025-02-13T05:19:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53312025-02-13T05:19:56.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53322025-02-13T05:19:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53332025-02-13T05:19:56.912ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 673.164908ms iteration = 24 status = {}
53342025-02-13T05:19:57.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 52103f6b-de37-4050-9ee5-fcf12d4df3e9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53352025-02-13T05:19:57.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 52103f6b-de37-4050-9ee5-fcf12d4df3e9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53362025-02-13T05:19:57.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2589 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 52103f6b-de37-4050-9ee5-fcf12d4df3e9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53372025-02-13T05:19:58.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6c8f92cb-f1e6-4959-b432-4295a0f6ce08 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53382025-02-13T05:19:58.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6c8f92cb-f1e6-4959-b432-4295a0f6ce08 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53392025-02-13T05:19:58.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2631 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6c8f92cb-f1e6-4959-b432-4295a0f6ce08 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53402025-02-13T05:19:59.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dc63e8af-7a53-41d5-a2e3-fcec9e939493 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53412025-02-13T05:19:59.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dc63e8af-7a53-41d5-a2e3-fcec9e939493 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53422025-02-13T05:19:59.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2826 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dc63e8af-7a53-41d5-a2e3-fcec9e939493 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53432025-02-13T05:20:00.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 500 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 80c90d27-a777-4fc9-b95f-6ff23462427e response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
53442025-02-13T05:20:00.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 11b628fd-a52b-48da-839c-f7b7bc727c1a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53452025-02-13T05:20:00.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 11b628fd-a52b-48da-839c-f7b7bc727c1a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53462025-02-13T05:20:00.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 11b628fd-a52b-48da-839c-f7b7bc727c1a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53472025-02-13T05:20:01.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 28288463-3d73-466f-bf74-c54684881178 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53482025-02-13T05:20:01.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 28288463-3d73-466f-bf74-c54684881178 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53492025-02-13T05:20:01.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 28288463-3d73-466f-bf74-c54684881178 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53502025-02-13T05:20:02.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 290bec88-42af-4888-b858-128f235a5334 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53512025-02-13T05:20:02.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 290bec88-42af-4888-b858-128f235a5334 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53522025-02-13T05:20:02.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 290bec88-42af-4888-b858-128f235a5334 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53532025-02-13T05:20:03.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c4c2f339-a875-403d-a403-8faab3a11f70 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53542025-02-13T05:20:03.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c4c2f339-a875-403d-a403-8faab3a11f70 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53552025-02-13T05:20:03.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2681 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c4c2f339-a875-403d-a403-8faab3a11f70 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53562025-02-13T05:20:04.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1a531080-422b-4f9d-b988-28e71a4e0432 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53572025-02-13T05:20:04.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1a531080-422b-4f9d-b988-28e71a4e0432 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53582025-02-13T05:20:04.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1a531080-422b-4f9d-b988-28e71a4e0432 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53592025-02-13T05:20:05.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8b6b41b5-2b7c-495c-90a1-a1153c3ae9bb roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53602025-02-13T05:20:05.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8b6b41b5-2b7c-495c-90a1-a1153c3ae9bb resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53612025-02-13T05:20:05.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8b6b41b5-2b7c-495c-90a1-a1153c3ae9bb response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53622025-02-13T05:20:06.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
53632025-02-13T05:20:06.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
53642025-02-13T05:20:06.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53652025-02-13T05:20:06.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53662025-02-13T05:20:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53672025-02-13T05:20:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53682025-02-13T05:20:06.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53692025-02-13T05:20:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53702025-02-13T05:20:06.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53712025-02-13T05:20:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53722025-02-13T05:20:06.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53732025-02-13T05:20:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53742025-02-13T05:20:06.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53752025-02-13T05:20:06.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
53762025-02-13T05:20:06.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53772025-02-13T05:20:06.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53782025-02-13T05:20:06.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53792025-02-13T05:20:06.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53802025-02-13T05:20:06.290ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
53812025-02-13T05:20:06.290ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.567509ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
53822025-02-13T05:20:06.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.828123ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53832025-02-13T05:20:06.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 59daea2a-8e3b-4e3b-b55a-d368619b8328 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53842025-02-13T05:20:06.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 59daea2a-8e3b-4e3b-b55a-d368619b8328 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53852025-02-13T05:20:06.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 59daea2a-8e3b-4e3b-b55a-d368619b8328 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53862025-02-13T05:20:07.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = df8be15f-dd1e-43e2-a7ac-194427c6b096 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53872025-02-13T05:20:07.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = df8be15f-dd1e-43e2-a7ac-194427c6b096 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53882025-02-13T05:20:07.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = df8be15f-dd1e-43e2-a7ac-194427c6b096 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53892025-02-13T05:20:08.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1f4c2d5d-17ab-4c76-87d7-128313218887 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53902025-02-13T05:20:08.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1f4c2d5d-17ab-4c76-87d7-128313218887 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53912025-02-13T05:20:08.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1f4c2d5d-17ab-4c76-87d7-128313218887 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53922025-02-13T05:20:09.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9cff01c9-8b45-4907-948a-7e5b3bed84dc roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53932025-02-13T05:20:09.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9cff01c9-8b45-4907-948a-7e5b3bed84dc resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53942025-02-13T05:20:09.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1798 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9cff01c9-8b45-4907-948a-7e5b3bed84dc response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53952025-02-13T05:20:10.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 506 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 996d4cd6-5c57-40e7-b835-10f39f85aebf response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
53962025-02-13T05:20:10.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = efc4df27-a8a0-40ad-9630-5592a40fa074 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53972025-02-13T05:20:10.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = efc4df27-a8a0-40ad-9630-5592a40fa074 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53982025-02-13T05:20:10.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = efc4df27-a8a0-40ad-9630-5592a40fa074 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
53992025-02-13T05:20:11.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b8a1ead6-bb23-464b-94ca-dd9e799e4bbb roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54002025-02-13T05:20:11.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b8a1ead6-bb23-464b-94ca-dd9e799e4bbb resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54012025-02-13T05:20:11.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b8a1ead6-bb23-464b-94ca-dd9e799e4bbb response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54022025-02-13T05:20:12.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 48462d8b-5ba2-4a80-97f8-e97bd48ed036 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54032025-02-13T05:20:12.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 48462d8b-5ba2-4a80-97f8-e97bd48ed036 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54042025-02-13T05:20:12.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 48462d8b-5ba2-4a80-97f8-e97bd48ed036 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54052025-02-13T05:20:13.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c1bd342d-bcd7-40a9-8829-4b07236c79f5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54062025-02-13T05:20:13.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c1bd342d-bcd7-40a9-8829-4b07236c79f5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54072025-02-13T05:20:13.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c1bd342d-bcd7-40a9-8829-4b07236c79f5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54082025-02-13T05:20:14.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7b69dd0c-bced-47a2-8e53-c0103f78387a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54092025-02-13T05:20:14.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7b69dd0c-bced-47a2-8e53-c0103f78387a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54102025-02-13T05:20:14.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1935 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7b69dd0c-bced-47a2-8e53-c0103f78387a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54112025-02-13T05:20:15.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ec352d5b-91dc-40ed-af0e-e240f14dda76 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54122025-02-13T05:20:15.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ec352d5b-91dc-40ed-af0e-e240f14dda76 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54132025-02-13T05:20:15.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ec352d5b-91dc-40ed-af0e-e240f14dda76 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54142025-02-13T05:20:16.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
54152025-02-13T05:20:16.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
54162025-02-13T05:20:16.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54172025-02-13T05:20:16.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54182025-02-13T05:20:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54192025-02-13T05:20:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54202025-02-13T05:20:16.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54212025-02-13T05:20:16.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222025-02-13T05:20:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54232025-02-13T05:20:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54242025-02-13T05:20:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54252025-02-13T05:20:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54262025-02-13T05:20:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54272025-02-13T05:20:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54282025-02-13T05:20:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54292025-02-13T05:20:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
54302025-02-13T05:20:16.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54312025-02-13T05:20:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54322025-02-13T05:20:16.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
54332025-02-13T05:20:16.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.204316ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
54342025-02-13T05:20:16.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.914789ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54352025-02-13T05:20:16.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3ac1eda3-9303-443e-9ec6-20955f09a87a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54362025-02-13T05:20:16.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3ac1eda3-9303-443e-9ec6-20955f09a87a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54372025-02-13T05:20:16.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3ac1eda3-9303-443e-9ec6-20955f09a87a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54382025-02-13T05:20:17.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1890e6d0-3433-4d5f-9dcf-3bff8b833c6b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54392025-02-13T05:20:17.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1890e6d0-3433-4d5f-9dcf-3bff8b833c6b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54402025-02-13T05:20:17.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2603 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1890e6d0-3433-4d5f-9dcf-3bff8b833c6b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54412025-02-13T05:20:18.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9fe2f95a-4759-450a-b0ac-f24cfcc7c2ff roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54422025-02-13T05:20:18.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9fe2f95a-4759-450a-b0ac-f24cfcc7c2ff resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54432025-02-13T05:20:18.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9fe2f95a-4759-450a-b0ac-f24cfcc7c2ff response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54442025-02-13T05:20:19.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 581676aa-5086-47e3-be72-e7ea8f9d8620 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54452025-02-13T05:20:19.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 581676aa-5086-47e3-be72-e7ea8f9d8620 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54462025-02-13T05:20:19.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2721 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 581676aa-5086-47e3-be72-e7ea8f9d8620 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54472025-02-13T05:20:20.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 485 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 97b02b03-b510-454b-a7d7-4d6e73e929cd response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
54482025-02-13T05:20:20.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1e2cfb78-ca5c-4b8b-8879-e67df1011c24 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54492025-02-13T05:20:20.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1e2cfb78-ca5c-4b8b-8879-e67df1011c24 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54502025-02-13T05:20:20.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1e2cfb78-ca5c-4b8b-8879-e67df1011c24 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54512025-02-13T05:20:21.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 32f63a29-6291-473f-94f5-0594d10ff0bb roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54522025-02-13T05:20:21.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 32f63a29-6291-473f-94f5-0594d10ff0bb resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54532025-02-13T05:20:21.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 32f63a29-6291-473f-94f5-0594d10ff0bb response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54542025-02-13T05:20:22.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 85c62cde-19ae-4608-9a82-41f2b67bab91 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54552025-02-13T05:20:22.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 85c62cde-19ae-4608-9a82-41f2b67bab91 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54562025-02-13T05:20:22.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 85c62cde-19ae-4608-9a82-41f2b67bab91 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54572025-02-13T05:20:23.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 19aa2d2a-7a42-45fc-ac8c-b957724bca54 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54582025-02-13T05:20:23.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 19aa2d2a-7a42-45fc-ac8c-b957724bca54 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54592025-02-13T05:20:23.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 19aa2d2a-7a42-45fc-ac8c-b957724bca54 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54602025-02-13T05:20:24.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3a6a0a08-e42e-40c1-983a-52d383f37a21 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54612025-02-13T05:20:24.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3a6a0a08-e42e-40c1-983a-52d383f37a21 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54622025-02-13T05:20:24.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3a6a0a08-e42e-40c1-983a-52d383f37a21 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54632025-02-13T05:20:25.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5e6a03b5-8472-43a4-a25e-eeb4e4b7a7de roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54642025-02-13T05:20:25.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5e6a03b5-8472-43a4-a25e-eeb4e4b7a7de resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54652025-02-13T05:20:25.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5e6a03b5-8472-43a4-a25e-eeb4e4b7a7de response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
54662025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
54672025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
54682025-02-13T05:20:26.239ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = e132683f-3ab0-4513-890f-86716ec9a9cf
54692025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
54702025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.98\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf"}
54712025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
54722025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
54732025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54742025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
54752025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54762025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
54772025-02-13T05:20:26.239ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54782025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54792025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54802025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
54812025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
54822025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54832025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54842025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
54852025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54862025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
54872025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54882025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
54892025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
54902025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
54912025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54922025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
54932025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
54942025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54952025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
54962025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54972025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
54982025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54992025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
55002025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
55012025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55022025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55032025-02-13T05:20:26.239ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
55042025-02-13T05:20:26.240ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-13 05:10:26.239785501 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
55052025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
55062025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
55072025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
55082025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55092025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
55102025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
55112025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55122025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
55132025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55142025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
55152025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
55162025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55172025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
55182025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55192025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
55202025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
55212025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55222025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55232025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
55242025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
55252025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55262025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
55272025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
55282025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55292025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
55302025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55312025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
55322025-02-13T05:20:26.240ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
55332025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55342025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55352025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
55362025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55372025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55382025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55392025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55402025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55412025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55422025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55432025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55442025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55452025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
55462025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
55472025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
55482025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55492025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
55502025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
55512025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55522025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55532025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55542025-02-13T05:20:26.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec95727a-7af6-45d1-9962-81bf544db84b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 781236136 } })
55552025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55562025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55572025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55582025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55592025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55602025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55612025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55622025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55632025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55642025-02-13T05:20:26.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9f4eb8b3-c464-433c-b912-c7432c124258.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cc24f910-ffb5-4de8-b7e1-4b9d4d15a7cd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 781286107 } })
55652025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
55662025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55672025-02-13T05:20:26.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55682025-02-13T05:20:26.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
55692025-02-13T05:20:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.08504ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
55702025-02-13T05:20:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55712025-02-13T05:20:26.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55722025-02-13T05:20:26.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
55732025-02-13T05:20:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.138333ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
55742025-02-13T05:20:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55752025-02-13T05:20:26.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55762025-02-13T05:20:26.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55772025-02-13T05:20:26.244ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.473487ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
55782025-02-13T05:20:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55792025-02-13T05:20:26.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55802025-02-13T05:20:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55812025-02-13T05:20:26.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55822025-02-13T05:20:26.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55832025-02-13T05:20:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55842025-02-13T05:20:26.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 789050828 } })
55852025-02-13T05:20:26.248ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
55862025-02-13T05:20:26.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55872025-02-13T05:20:26.257ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 798418924 } })
55882025-02-13T05:20:26.258ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
55892025-02-13T05:20:26.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55902025-02-13T05:20:26.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55912025-02-13T05:20:26.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55922025-02-13T05:20:26.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55932025-02-13T05:20:26.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55942025-02-13T05:20:26.260ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.141351ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
55952025-02-13T05:20:26.261ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-13 05:10:26.239785501 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
55962025-02-13T05:20:26.261ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 21.862762ms iteration = 13 status = {"expiration":"2025-02-13T05:10:26.239785501Z","pruned":[]}
55972025-02-13T05:20:26.263ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55982025-02-13T05:20:26.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55992025-02-13T05:20:26.265ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56002025-02-13T05:20:26.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56012025-02-13T05:20:26.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56022025-02-13T05:20:26.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56032025-02-13T05:20:26.267ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56042025-02-13T05:20:26.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56052025-02-13T05:20:26.269ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56062025-02-13T05:20:26.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56072025-02-13T05:20:26.271ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56082025-02-13T05:20:26.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
56092025-02-13T05:20:26.278ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56102025-02-13T05:20:26.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56112025-02-13T05:20:26.284ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56122025-02-13T05:20:26.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
56132025-02-13T05:20:26.287ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56142025-02-13T05:20:26.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56152025-02-13T05:20:26.292ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56162025-02-13T05:20:26.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
56172025-02-13T05:20:26.297ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56182025-02-13T05:20:26.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56192025-02-13T05:20:26.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56202025-02-13T05:20:26.305ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56212025-02-13T05:20:26.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56222025-02-13T05:20:26.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56232025-02-13T05:20:26.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56242025-02-13T05:20:26.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
56252025-02-13T05:20:26.308ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56262025-02-13T05:20:26.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56272025-02-13T05:20:26.310ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.604718ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
56282025-02-13T05:20:26.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56292025-02-13T05:20:26.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56302025-02-13T05:20:26.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56312025-02-13T05:20:26.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56322025-02-13T05:20:26.322ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56332025-02-13T05:20:26.322ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56342025-02-13T05:20:26.322ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56352025-02-13T05:20:26.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56362025-02-13T05:20:26.322ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56372025-02-13T05:20:26.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56382025-02-13T05:20:26.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56392025-02-13T05:20:26.326ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56402025-02-13T05:20:26.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56412025-02-13T05:20:26.326ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56422025-02-13T05:20:26.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.922162ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
56432025-02-13T05:20:26.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
56442025-02-13T05:20:26.326ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56452025-02-13T05:20:26.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56462025-02-13T05:20:26.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56472025-02-13T05:20:26.327ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56482025-02-13T05:20:26.327ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 88.170318ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
56492025-02-13T05:20:26.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56502025-02-13T05:20:26.328ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56512025-02-13T05:20:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56522025-02-13T05:20:26.329ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56532025-02-13T05:20:26.329ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
56542025-02-13T05:20:26.329ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
56552025-02-13T05:20:26.329ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.145425ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
56562025-02-13T05:20:26.329ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56572025-02-13T05:20:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56582025-02-13T05:20:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56592025-02-13T05:20:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56602025-02-13T05:20:26.330ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56612025-02-13T05:20:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56622025-02-13T05:20:26.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56632025-02-13T05:20:26.332ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56642025-02-13T05:20:26.332ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56652025-02-13T05:20:26.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56662025-02-13T05:20:26.332ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 93.414787ms iteration = 6 status = {"nsuccess":5}
56672025-02-13T05:20:26.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56682025-02-13T05:20:26.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56692025-02-13T05:20:26.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56702025-02-13T05:20:26.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56712025-02-13T05:20:26.336ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56722025-02-13T05:20:26.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56732025-02-13T05:20:26.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56742025-02-13T05:20:26.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56752025-02-13T05:20:26.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56762025-02-13T05:20:26.340ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.155299ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56772025-02-13T05:20:26.340ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56782025-02-13T05:20:26.340ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56792025-02-13T05:20:26.340ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56802025-02-13T05:20:26.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56812025-02-13T05:20:26.342ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56822025-02-13T05:20:26.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56832025-02-13T05:20:26.344ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56842025-02-13T05:20:26.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56852025-02-13T05:20:26.344ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56862025-02-13T05:20:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56872025-02-13T05:20:26.345ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.182721ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56882025-02-13T05:20:26.346ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 886776048 } })
56892025-02-13T05:20:26.346ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
56902025-02-13T05:20:26.350ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
56912025-02-13T05:20:26.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.235735ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
56922025-02-13T05:20:26.381ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
56932025-02-13T05:20:26.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56942025-02-13T05:20:26.385ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
56952025-02-13T05:20:26.385ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
56962025-02-13T05:20:26.385ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
56972025-02-13T05:20:26.385ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
56982025-02-13T05:20:26.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56992025-02-13T05:20:26.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57002025-02-13T05:20:26.388ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
57012025-02-13T05:20:26.388ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
57022025-02-13T05:20:26.388ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
57032025-02-13T05:20:26.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57042025-02-13T05:20:26.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57052025-02-13T05:20:26.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57062025-02-13T05:20:26.390ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57072025-02-13T05:20:26.391ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57082025-02-13T05:20:26.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57092025-02-13T05:20:26.394ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
57102025-02-13T05:20:26.394ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57112025-02-13T05:20:26.394ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
57122025-02-13T05:20:26.394ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
57132025-02-13T05:20:26.394ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 154.576087ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
57142025-02-13T05:20:26.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57152025-02-13T05:20:26.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57162025-02-13T05:20:26.395ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "79cb43a7-8c63-444a-a384-873a31927acd", "content-length": "26", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
57172025-02-13T05:20:26.395ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57182025-02-13T05:20:26.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57192025-02-13T05:20:26.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57202025-02-13T05:20:26.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57212025-02-13T05:20:26.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57222025-02-13T05:20:26.406ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57232025-02-13T05:20:26.406ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57242025-02-13T05:20:26.406ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57252025-02-13T05:20:26.406ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 166.802065ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57262025-02-13T05:20:26.406ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57272025-02-13T05:20:26.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57282025-02-13T05:20:26.410ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57292025-02-13T05:20:26.412ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57302025-02-13T05:20:26.412ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 172.582249ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57312025-02-13T05:20:26.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57322025-02-13T05:20:26.413ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57332025-02-13T05:20:26.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57342025-02-13T05:20:26.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 183.390187ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57352025-02-13T05:20:26.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57362025-02-13T05:20:26.423ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57372025-02-13T05:20:26.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57382025-02-13T05:20:26.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57392025-02-13T05:20:26.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57402025-02-13T05:20:26.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
57412025-02-13T05:20:26.428ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57422025-02-13T05:20:26.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57432025-02-13T05:20:26.431ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57442025-02-13T05:20:26.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
57452025-02-13T05:20:26.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57462025-02-13T05:20:26.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57472025-02-13T05:20:26.440ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 200.871024ms iteration = 25 status = 0
57482025-02-13T05:20:26.446ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57492025-02-13T05:20:26.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57502025-02-13T05:20:26.449ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
57512025-02-13T05:20:26.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 232.303228ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
57522025-02-13T05:20:26.472ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
57532025-02-13T05:20:26.472ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
57542025-02-13T05:20:26.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57552025-02-13T05:20:26.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57562025-02-13T05:20:26.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57572025-02-13T05:20:26.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57582025-02-13T05:20:26.478ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57592025-02-13T05:20:26.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57602025-02-13T05:20:26.481ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57612025-02-13T05:20:26.483ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
57622025-02-13T05:20:26.483ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 0 version = 2
57632025-02-13T05:20:26.483ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57642025-02-13T05:20:26.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57652025-02-13T05:20:26.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
57662025-02-13T05:20:26.485ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57672025-02-13T05:20:26.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57682025-02-13T05:20:26.496ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57692025-02-13T05:20:26.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57702025-02-13T05:20:26.526ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
57712025-02-13T05:20:26.526ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57722025-02-13T05:20:26.527ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae7bea04-fc07-43ff-af4f-62f8acf3389e", "content-length": "26", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
57732025-02-13T05:20:26.527ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57742025-02-13T05:20:26.532ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57752025-02-13T05:20:26.533ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
57762025-02-13T05:20:26.533ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 293.817208ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
57772025-02-13T05:20:26.554ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
57782025-02-13T05:20:26.554ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57792025-02-13T05:20:26.554ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "13a32b23-b1cb-4d68-be05-96b6b28421c5", "content-length": "26", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
57802025-02-13T05:20:26.554ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57812025-02-13T05:20:26.556ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
57822025-02-13T05:20:26.607ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 367.00407ms iteration = 27 status = {"physical_disks_added":0}
57832025-02-13T05:20:26.613ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 373.829544ms iteration = 25 status = {}
57842025-02-13T05:20:26.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57852025-02-13T05:20:26.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57862025-02-13T05:20:26.642ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57872025-02-13T05:20:26.642ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57882025-02-13T05:20:26.643ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb232994-9dbe-4b3b-81d1-3ff1988ab0d4", "content-length": "372", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
57892025-02-13T05:20:26.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57902025-02-13T05:20:26.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57912025-02-13T05:20:26.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922025-02-13T05:20:26.645ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
57932025-02-13T05:20:26.645ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
57942025-02-13T05:20:26.645ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-13 05:08:26.528706 UTC dns_group = internal generation = 1
57952025-02-13T05:20:26.645ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 405.510755ms iteration = 13 status = {"generation":1}
57962025-02-13T05:20:26.645ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57972025-02-13T05:20:26.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57982025-02-13T05:20:26.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57992025-02-13T05:20:26.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58002025-02-13T05:20:26.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58012025-02-13T05:20:26.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58022025-02-13T05:20:26.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58032025-02-13T05:20:26.651ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 1 version = 2
58042025-02-13T05:20:26.651ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
58052025-02-13T05:20:26.651ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-13 05:08:27.963644 UTC dns_group = external generation = 2
58062025-02-13T05:20:26.651ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 411.860636ms iteration = 13 status = {"generation":2}
58072025-02-13T05:20:26.659ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
58082025-02-13T05:20:26.660ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1b88a34e-cf60-457b-9fd2-54b4a171ecd9", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58092025-02-13T05:20:26.660ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58102025-02-13T05:20:26.662ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "50472086-e4b2-4b3c-aa42-1014770e4c97", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58112025-02-13T05:20:26.662ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58122025-02-13T05:20:26.664ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58132025-02-13T05:20:26.664ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 424.515665ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
58142025-02-13T05:20:26.682ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
58152025-02-13T05:20:26.682ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 442.753454ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
58162025-02-13T05:20:26.688ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58172025-02-13T05:20:26.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58182025-02-13T05:20:26.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58192025-02-13T05:20:26.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58202025-02-13T05:20:26.691ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-13T05:08:23.439194Z, time_modified: 2025-02-13T05:08:23.439194Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }) }
58212025-02-13T05:20:26.691ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 451.537374ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]}},"default_endpoint":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
58222025-02-13T05:20:26.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58232025-02-13T05:20:26.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58242025-02-13T05:20:26.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58252025-02-13T05:20:26.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58262025-02-13T05:20:26.702ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58272025-02-13T05:20:26.702ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58282025-02-13T05:20:26.702ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "150325a2-5b3a-4e25-b56e-8546b71c045e", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
58292025-02-13T05:20:26.702ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58302025-02-13T05:20:26.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58312025-02-13T05:20:26.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58322025-02-13T05:20:26.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58332025-02-13T05:20:26.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58342025-02-13T05:20:26.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58352025-02-13T05:20:26.711ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58362025-02-13T05:20:26.712ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58372025-02-13T05:20:26.712ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0ea16f01-3818-4df4-adf2-ff046e278a0f", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
58382025-02-13T05:20:26.714ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 474.602891ms iteration = 26 status = {}
58392025-02-13T05:20:26.808ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
58402025-02-13T05:20:26.824ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58412025-02-13T05:20:26.825ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "240b214c-a821-41c6-9d54-e2d94ae2147d", "content-length": "2", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
58422025-02-13T05:20:26.826ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58432025-02-13T05:20:26.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58442025-02-13T05:20:26.829ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 589.818578ms iteration = 25 status = null
58452025-02-13T05:20:26.857ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58462025-02-13T05:20:26.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 64d7d30d-20fc-492c-b1f0-15bf75ac39f5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
58472025-02-13T05:20:26.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 64d7d30d-20fc-492c-b1f0-15bf75ac39f5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
58482025-02-13T05:20:26.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a921ae3b-2515-40c2-a25e-a98d7b6d551c", "content-length": "691", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
58492025-02-13T05:20:26.909ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58502025-02-13T05:20:26.909ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58512025-02-13T05:20:26.909ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58522025-02-13T05:20:26.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1966 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 64d7d30d-20fc-492c-b1f0-15bf75ac39f5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
58532025-02-13T05:20:26.911ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 672.146868ms iteration = 26 status = {}
58542025-02-13T05:20:26.941ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
58552025-02-13T05:20:26.941ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "48c96c35-f18b-4877-b31d-22b144ed3c35", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58562025-02-13T05:20:26.941ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58572025-02-13T05:20:26.942ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dd8ca27d-6043-4566-be12-85ece61fbb96", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58582025-02-13T05:20:26.942ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58592025-02-13T05:20:26.944ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "841d1c01-1baa-4a32-8548-218f597fd4fe", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58602025-02-13T05:20:26.944ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58612025-02-13T05:20:26.946ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58622025-02-13T05:20:26.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 706.333302ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
58632025-02-13T05:20:26.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58642025-02-13T05:20:26.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58652025-02-13T05:20:26.988ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
58662025-02-13T05:20:26.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58672025-02-13T05:20:26.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58682025-02-13T05:20:26.999ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58692025-02-13T05:20:26.999ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c85fc5e-d306-455d-b733-098596bc4418", "content-length": "134", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
58702025-02-13T05:20:26.999ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
58712025-02-13T05:20:26.999ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
58722025-02-13T05:20:27.000ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
58732025-02-13T05:20:27.000ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58742025-02-13T05:20:27.000ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58752025-02-13T05:20:27.000ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58762025-02-13T05:20:27.000ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58772025-02-13T05:20:27.000ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58782025-02-13T05:20:27.000ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58792025-02-13T05:20:27.000ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58802025-02-13T05:20:27.000ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
58812025-02-13T05:20:27.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58822025-02-13T05:20:27.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58832025-02-13T05:20:27.002ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
58842025-02-13T05:20:27.002ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "387e358d-60e2-445b-9f78-ffe7b4775c4e", "content-length": "2", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
58852025-02-13T05:20:27.002ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
58862025-02-13T05:20:27.002ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b424324b-8aa0-4e2a-97d9-edd59e41ec5e", "content-length": "52", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
58872025-02-13T05:20:27.002ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
58882025-02-13T05:20:27.002ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58892025-02-13T05:20:27.102ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "53fecdef-b4e5-460a-a6cf-4c56b9a83f48", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
58902025-02-13T05:20:27.102ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
58912025-02-13T05:20:27.102ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58922025-02-13T05:20:27.103ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ec8346b-31c1-42e1-8c3c-03c80c517e29", "content-length": "682", "date": "Thu, 13 Feb 2025 05:20:26 GMT"} })
58932025-02-13T05:20:27.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58942025-02-13T05:20:27.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58952025-02-13T05:20:27.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58962025-02-13T05:20:27.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58972025-02-13T05:20:27.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58982025-02-13T05:20:27.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58992025-02-13T05:20:27.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59002025-02-13T05:20:27.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59012025-02-13T05:20:27.119ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 879.629971ms iteration = 25 status = {}
59022025-02-13T05:20:27.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb742192-8dc8-47e3-9e14-a7f64a585131 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59032025-02-13T05:20:27.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb742192-8dc8-47e3-9e14-a7f64a585131 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59042025-02-13T05:20:27.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1721 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cb742192-8dc8-47e3-9e14-a7f64a585131 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59052025-02-13T05:20:28.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 851fef70-3b02-43c0-82cc-db9aba6ce251 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59062025-02-13T05:20:28.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 851fef70-3b02-43c0-82cc-db9aba6ce251 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59072025-02-13T05:20:28.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 851fef70-3b02-43c0-82cc-db9aba6ce251 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59082025-02-13T05:20:29.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 85a909ac-f8c9-46c2-8611-ae269fe73ab3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59092025-02-13T05:20:29.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 85a909ac-f8c9-46c2-8611-ae269fe73ab3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59102025-02-13T05:20:29.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 85a909ac-f8c9-46c2-8611-ae269fe73ab3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59112025-02-13T05:20:30.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 508 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 1a197aa7-afaa-4953-a8be-ecd9a18746a6 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
59122025-02-13T05:20:30.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 60e10738-8dd0-4c90-b058-84f24bdac8d0 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59132025-02-13T05:20:30.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 60e10738-8dd0-4c90-b058-84f24bdac8d0 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59142025-02-13T05:20:30.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 60e10738-8dd0-4c90-b058-84f24bdac8d0 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59152025-02-13T05:20:32.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6ed2133f-ba7a-415f-87e0-b6af5b4dcd1e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59162025-02-13T05:20:32.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6ed2133f-ba7a-415f-87e0-b6af5b4dcd1e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59172025-02-13T05:20:32.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6ed2133f-ba7a-415f-87e0-b6af5b4dcd1e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59182025-02-13T05:20:33.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f2c74d6f-c070-41e3-8cfd-5c1fb1fb34d4 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59192025-02-13T05:20:33.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f2c74d6f-c070-41e3-8cfd-5c1fb1fb34d4 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59202025-02-13T05:20:33.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f2c74d6f-c070-41e3-8cfd-5c1fb1fb34d4 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59212025-02-13T05:20:34.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2f452c19-65a6-48e5-a46c-be970522804c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59222025-02-13T05:20:34.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2f452c19-65a6-48e5-a46c-be970522804c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59232025-02-13T05:20:34.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2f452c19-65a6-48e5-a46c-be970522804c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59242025-02-13T05:20:35.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 226b2e43-7cd9-4d99-afad-afd1f94661e7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59252025-02-13T05:20:35.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 226b2e43-7cd9-4d99-afad-afd1f94661e7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59262025-02-13T05:20:35.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2879 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 226b2e43-7cd9-4d99-afad-afd1f94661e7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59272025-02-13T05:20:36.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9babade-6e57-4fa0-9f3f-faafa3cd9210 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59282025-02-13T05:20:36.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9babade-6e57-4fa0-9f3f-faafa3cd9210 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59292025-02-13T05:20:36.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2920 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9babade-6e57-4fa0-9f3f-faafa3cd9210 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59302025-02-13T05:20:36.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
59312025-02-13T05:20:36.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
59322025-02-13T05:20:36.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59332025-02-13T05:20:36.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59342025-02-13T05:20:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59352025-02-13T05:20:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59362025-02-13T05:20:36.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59372025-02-13T05:20:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59382025-02-13T05:20:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59392025-02-13T05:20:36.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.658255ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59402025-02-13T05:20:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59412025-02-13T05:20:36.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59422025-02-13T05:20:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59432025-02-13T05:20:36.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59442025-02-13T05:20:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59452025-02-13T05:20:36.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59462025-02-13T05:20:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
59472025-02-13T05:20:36.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59482025-02-13T05:20:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59492025-02-13T05:20:36.260ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
59502025-02-13T05:20:36.260ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.531123ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
59512025-02-13T05:20:37.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 581630bc-6a79-4995-b8d0-16294d95af3f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59522025-02-13T05:20:37.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 581630bc-6a79-4995-b8d0-16294d95af3f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59532025-02-13T05:20:37.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 581630bc-6a79-4995-b8d0-16294d95af3f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59542025-02-13T05:20:38.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f3512122-2e13-431a-85df-9f035eb51262 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59552025-02-13T05:20:38.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f3512122-2e13-431a-85df-9f035eb51262 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59562025-02-13T05:20:38.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f3512122-2e13-431a-85df-9f035eb51262 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59572025-02-13T05:20:39.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4a7a974e-52c2-47a1-a34b-b72fdc4f2da2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59582025-02-13T05:20:39.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4a7a974e-52c2-47a1-a34b-b72fdc4f2da2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59592025-02-13T05:20:39.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2711 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4a7a974e-52c2-47a1-a34b-b72fdc4f2da2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59602025-02-13T05:20:40.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a59bab9d-774e-446a-884b-dd0e1fa9a5e5 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
59612025-02-13T05:20:40.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a59bab9d-774e-446a-884b-dd0e1fa9a5e5 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
59622025-02-13T05:20:40.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3651 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a59bab9d-774e-446a-884b-dd0e1fa9a5e5 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
59632025-02-13T05:20:40.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 781a1598-a307-4af9-912e-2654b9fe95f6 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
59642025-02-13T05:20:40.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 781a1598-a307-4af9-912e-2654b9fe95f6 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
59652025-02-13T05:20:40.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2657 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 781a1598-a307-4af9-912e-2654b9fe95f6 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
59662025-02-13T05:20:40.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 383 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = e696ce86-7f81-4582-872c-246580f32fc7 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
59672025-02-13T05:20:40.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8e307325-5294-46f7-a97e-936e3d86fdd7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59682025-02-13T05:20:40.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8e307325-5294-46f7-a97e-936e3d86fdd7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59692025-02-13T05:20:40.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2067 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8e307325-5294-46f7-a97e-936e3d86fdd7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59702025-02-13T05:20:41.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 600a11fa-ad83-4c91-9d68-9c55058ef849 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59712025-02-13T05:20:41.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 600a11fa-ad83-4c91-9d68-9c55058ef849 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59722025-02-13T05:20:41.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2063 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 600a11fa-ad83-4c91-9d68-9c55058ef849 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59732025-02-13T05:20:42.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b603921f-b51f-4f6a-873d-89dae1c0a2fd roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59742025-02-13T05:20:42.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b603921f-b51f-4f6a-873d-89dae1c0a2fd resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59752025-02-13T05:20:42.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2674 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b603921f-b51f-4f6a-873d-89dae1c0a2fd response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59762025-02-13T05:20:43.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5a124880-53bf-40fb-84bb-9e2507d4c3c8 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59772025-02-13T05:20:43.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5a124880-53bf-40fb-84bb-9e2507d4c3c8 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59782025-02-13T05:20:43.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2716 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5a124880-53bf-40fb-84bb-9e2507d4c3c8 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59792025-02-13T05:20:44.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cc828e03-e56d-4840-b833-c1f934161957 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59802025-02-13T05:20:44.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cc828e03-e56d-4840-b833-c1f934161957 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59812025-02-13T05:20:44.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cc828e03-e56d-4840-b833-c1f934161957 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59822025-02-13T05:20:45.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b0f2ea3c-c23f-492e-b060-2325b6b07077 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59832025-02-13T05:20:45.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b0f2ea3c-c23f-492e-b060-2325b6b07077 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59842025-02-13T05:20:45.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b0f2ea3c-c23f-492e-b060-2325b6b07077 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
59852025-02-13T05:20:46.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
59862025-02-13T05:20:46.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
59872025-02-13T05:20:46.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59882025-02-13T05:20:46.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59892025-02-13T05:20:46.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59902025-02-13T05:20:46.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59912025-02-13T05:20:46.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59922025-02-13T05:20:46.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59932025-02-13T05:20:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59942025-02-13T05:20:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59952025-02-13T05:20:46.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59962025-02-13T05:20:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59972025-02-13T05:20:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59982025-02-13T05:20:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59992025-02-13T05:20:46.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60002025-02-13T05:20:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
60012025-02-13T05:20:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60022025-02-13T05:20:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60032025-02-13T05:20:46.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
60042025-02-13T05:20:46.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.063699ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
60052025-02-13T05:20:46.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.461196ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60062025-02-13T05:20:46.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a642608c-6241-4d73-a14a-50fa22f94722 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60072025-02-13T05:20:46.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a642608c-6241-4d73-a14a-50fa22f94722 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60082025-02-13T05:20:46.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a642608c-6241-4d73-a14a-50fa22f94722 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60092025-02-13T05:20:47.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1157f892-41d4-405f-a8fa-b958019091e3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60102025-02-13T05:20:47.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1157f892-41d4-405f-a8fa-b958019091e3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60112025-02-13T05:20:47.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1157f892-41d4-405f-a8fa-b958019091e3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60122025-02-13T05:20:48.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 38efaae1-c44b-4039-ae18-4fd9b6e21d7e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60132025-02-13T05:20:48.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 38efaae1-c44b-4039-ae18-4fd9b6e21d7e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60142025-02-13T05:20:48.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2618 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 38efaae1-c44b-4039-ae18-4fd9b6e21d7e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60152025-02-13T05:20:49.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7878b2e5-23a3-4d6b-b6da-52447c73742a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60162025-02-13T05:20:49.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7878b2e5-23a3-4d6b-b6da-52447c73742a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60172025-02-13T05:20:49.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7878b2e5-23a3-4d6b-b6da-52447c73742a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60182025-02-13T05:20:50.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 411 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = a092b6d9-b7ab-4071-b6ae-028bf4121fb3 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
60192025-02-13T05:20:50.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09a94594-cdf5-4f4e-8869-f314e5bc0e53 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60202025-02-13T05:20:50.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09a94594-cdf5-4f4e-8869-f314e5bc0e53 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60212025-02-13T05:20:50.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09a94594-cdf5-4f4e-8869-f314e5bc0e53 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60222025-02-13T05:20:51.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e4c1c0fc-d71f-402e-aafd-35fe228aa6b5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60232025-02-13T05:20:51.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e4c1c0fc-d71f-402e-aafd-35fe228aa6b5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60242025-02-13T05:20:51.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2609 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e4c1c0fc-d71f-402e-aafd-35fe228aa6b5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60252025-02-13T05:20:52.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d95f91ff-1704-4658-9454-d1a578358f7b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60262025-02-13T05:20:52.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d95f91ff-1704-4658-9454-d1a578358f7b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60272025-02-13T05:20:52.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d95f91ff-1704-4658-9454-d1a578358f7b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60282025-02-13T05:20:53.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fdc8098e-685f-48da-aaa7-ce3aa4ed1711 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60292025-02-13T05:20:53.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fdc8098e-685f-48da-aaa7-ce3aa4ed1711 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60302025-02-13T05:20:53.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fdc8098e-685f-48da-aaa7-ce3aa4ed1711 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60312025-02-13T05:20:54.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 86b235b7-33a7-48dc-8f37-356274f1a472 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60322025-02-13T05:20:54.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 86b235b7-33a7-48dc-8f37-356274f1a472 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60332025-02-13T05:20:54.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 86b235b7-33a7-48dc-8f37-356274f1a472 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60342025-02-13T05:20:55.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c285a48c-7e43-4125-9b68-96835ec8e19c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60352025-02-13T05:20:55.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c285a48c-7e43-4125-9b68-96835ec8e19c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60362025-02-13T05:20:55.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c285a48c-7e43-4125-9b68-96835ec8e19c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
60372025-02-13T05:20:56.238ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
60382025-02-13T05:20:56.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
60392025-02-13T05:20:56.238ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
60402025-02-13T05:20:56.238ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
60412025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
60422025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60432025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
60442025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60452025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60462025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
60472025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60482025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
60492025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60502025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
60512025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
60522025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60532025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60542025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
60552025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
60562025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60572025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
60582025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60592025-02-13T05:20:56.239ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60602025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60612025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
60622025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
60632025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60642025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60652025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
60662025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
60672025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60682025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60692025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
60702025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
60712025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60722025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
60732025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
60742025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60752025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60762025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60772025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60782025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60792025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
60802025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60812025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60822025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60832025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60842025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60852025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60862025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60872025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60882025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60892025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60902025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60912025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60922025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60932025-02-13T05:20:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60942025-02-13T05:20:56.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 783321035 } })
60952025-02-13T05:20:56.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
60962025-02-13T05:20:56.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.59759ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60972025-02-13T05:20:56.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60982025-02-13T05:20:56.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 786650430 } })
60992025-02-13T05:20:56.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
61002025-02-13T05:20:56.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61012025-02-13T05:20:56.246ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 7.781011ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
61022025-02-13T05:20:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61032025-02-13T05:20:56.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61042025-02-13T05:20:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61052025-02-13T05:20:56.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61062025-02-13T05:20:56.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61072025-02-13T05:20:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61082025-02-13T05:20:56.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61092025-02-13T05:20:56.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61102025-02-13T05:20:56.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61112025-02-13T05:20:56.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61122025-02-13T05:20:56.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61132025-02-13T05:20:56.256ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61142025-02-13T05:20:56.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61152025-02-13T05:20:56.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61162025-02-13T05:20:56.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61172025-02-13T05:20:56.258ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 799595268 } })
61182025-02-13T05:20:56.258ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
61192025-02-13T05:20:56.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61202025-02-13T05:20:56.259ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61212025-02-13T05:20:56.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61222025-02-13T05:20:56.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61232025-02-13T05:20:56.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61242025-02-13T05:20:56.267ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61252025-02-13T05:20:56.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61262025-02-13T05:20:56.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61272025-02-13T05:20:56.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61282025-02-13T05:20:56.272ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61292025-02-13T05:20:56.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61302025-02-13T05:20:56.293ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 54.13038ms iteration = 28 status = {"physical_disks_added":0}
61312025-02-13T05:20:56.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.992014ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
61322025-02-13T05:20:56.302ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61332025-02-13T05:20:56.302ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61342025-02-13T05:20:56.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61352025-02-13T05:20:56.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61362025-02-13T05:20:56.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61372025-02-13T05:20:56.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61382025-02-13T05:20:56.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61392025-02-13T05:20:56.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61402025-02-13T05:20:56.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61412025-02-13T05:20:56.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61422025-02-13T05:20:56.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61432025-02-13T05:20:56.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.840928ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61442025-02-13T05:20:56.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61452025-02-13T05:20:56.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61462025-02-13T05:20:56.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61472025-02-13T05:20:56.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61482025-02-13T05:20:56.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.487452ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
61492025-02-13T05:20:56.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61502025-02-13T05:20:56.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61512025-02-13T05:20:56.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61522025-02-13T05:20:56.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61532025-02-13T05:20:56.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61542025-02-13T05:20:56.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61552025-02-13T05:20:56.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61562025-02-13T05:20:56.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61572025-02-13T05:20:56.316ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61582025-02-13T05:20:56.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61592025-02-13T05:20:56.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61602025-02-13T05:20:56.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61612025-02-13T05:20:56.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61622025-02-13T05:20:56.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61632025-02-13T05:20:56.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61642025-02-13T05:20:56.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
61652025-02-13T05:20:56.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61662025-02-13T05:20:56.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61672025-02-13T05:20:56.318ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
61682025-02-13T05:20:56.318ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61692025-02-13T05:20:56.319ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b261ad2d-724d-4c7c-a0b3-2acf7595273b", "content-length": "26", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
61702025-02-13T05:20:56.319ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61712025-02-13T05:20:56.320ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61722025-02-13T05:20:56.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61732025-02-13T05:20:56.320ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 81.56724ms iteration = 26 status = 0
61742025-02-13T05:20:56.321ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
61752025-02-13T05:20:56.321ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61762025-02-13T05:20:56.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
61772025-02-13T05:20:56.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61782025-02-13T05:20:56.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61792025-02-13T05:20:56.322ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f8b4203-3056-4f68-9ee3-723b0e566163", "content-length": "26", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
61802025-02-13T05:20:56.322ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61812025-02-13T05:20:56.322ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61822025-02-13T05:20:56.323ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61832025-02-13T05:20:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61842025-02-13T05:20:56.324ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61852025-02-13T05:20:56.324ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61862025-02-13T05:20:56.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61872025-02-13T05:20:56.327ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61882025-02-13T05:20:56.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61892025-02-13T05:20:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61902025-02-13T05:20:56.348ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61912025-02-13T05:20:56.348ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61922025-02-13T05:20:56.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61932025-02-13T05:20:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61942025-02-13T05:20:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61952025-02-13T05:20:56.351ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
61962025-02-13T05:20:56.351ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.015826ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
61972025-02-13T05:20:56.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.136728ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
61982025-02-13T05:20:56.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 122.520945ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61992025-02-13T05:20:56.361ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62002025-02-13T05:20:56.361ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62012025-02-13T05:20:56.361ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.775733ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62022025-02-13T05:20:56.366ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
62032025-02-13T05:20:56.366ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62042025-02-13T05:20:56.367ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "afd6fbc4-e3d9-4c63-94c7-b13acf5bd314", "content-length": "26", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62052025-02-13T05:20:56.367ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62062025-02-13T05:20:56.369ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
62072025-02-13T05:20:56.374ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62082025-02-13T05:20:56.374ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 135.173595ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62092025-02-13T05:20:56.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 136.974786ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62102025-02-13T05:20:56.383ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
62112025-02-13T05:20:56.383ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 144.004866ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
62122025-02-13T05:20:56.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62132025-02-13T05:20:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62142025-02-13T05:20:56.418ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 179.282219ms iteration = 26 status = {}
62152025-02-13T05:20:56.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62162025-02-13T05:20:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62172025-02-13T05:20:56.442ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62182025-02-13T05:20:56.442ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "655c08ce-3e82-4581-967e-62c0e1847c95", "content-length": "2", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62192025-02-13T05:20:56.444ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62202025-02-13T05:20:56.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62212025-02-13T05:20:56.450ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 211.385243ms iteration = 26 status = null
62222025-02-13T05:20:56.477ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62232025-02-13T05:20:56.477ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62242025-02-13T05:20:56.478ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a5bf46d-647e-4aac-8e54-04690447cade", "content-length": "372", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62252025-02-13T05:20:56.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62262025-02-13T05:20:56.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62272025-02-13T05:20:56.484ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62282025-02-13T05:20:56.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62292025-02-13T05:20:56.486ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62302025-02-13T05:20:56.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62312025-02-13T05:20:56.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62322025-02-13T05:20:56.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62332025-02-13T05:20:56.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62342025-02-13T05:20:56.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62352025-02-13T05:20:56.493ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
62362025-02-13T05:20:56.493ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62372025-02-13T05:20:56.493ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c9f0f5d3-5eca-4f1d-97da-fa09c158ac4d", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62382025-02-13T05:20:56.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62392025-02-13T05:20:56.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62402025-02-13T05:20:56.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62412025-02-13T05:20:56.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62422025-02-13T05:20:56.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62432025-02-13T05:20:56.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62442025-02-13T05:20:56.503ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62452025-02-13T05:20:56.503ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62462025-02-13T05:20:56.504ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f68dfc83-06b2-4767-bdba-39db9c394eeb", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62472025-02-13T05:20:56.507ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 268.010114ms iteration = 27 status = {}
62482025-02-13T05:20:56.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0e9844be-404a-4d03-9dee-c4b5ed6fc3b7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
62492025-02-13T05:20:56.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0e9844be-404a-4d03-9dee-c4b5ed6fc3b7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
62502025-02-13T05:20:56.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2801 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0e9844be-404a-4d03-9dee-c4b5ed6fc3b7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
62512025-02-13T05:20:56.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62522025-02-13T05:20:56.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62532025-02-13T05:20:56.619ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62542025-02-13T05:20:56.621ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
62552025-02-13T05:20:56.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62562025-02-13T05:20:56.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62572025-02-13T05:20:56.632ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
62582025-02-13T05:20:56.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "397888d6-cb21-447a-9ac6-858c7386673c", "content-length": "134", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62592025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
62602025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
62612025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62622025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
62632025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62642025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62652025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62662025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62672025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62682025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62692025-02-13T05:20:56.633ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
62702025-02-13T05:20:56.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62712025-02-13T05:20:56.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62722025-02-13T05:20:56.636ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62732025-02-13T05:20:56.636ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f5513f8-f997-43b5-bd75-71f53f9372a0", "content-length": "2", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62742025-02-13T05:20:56.636ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62752025-02-13T05:20:56.636ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd180615-86bf-400d-80b0-0cf29fd7d2ac", "content-length": "52", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62762025-02-13T05:20:56.636ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
62772025-02-13T05:20:56.636ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62782025-02-13T05:20:56.694ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c84027ab-af7e-4f83-a6c8-a719b1ab2913", "content-length": "691", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62792025-02-13T05:20:56.694ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
62802025-02-13T05:20:56.694ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
62812025-02-13T05:20:56.694ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
62822025-02-13T05:20:56.695ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 456.270079ms iteration = 27 status = {}
62832025-02-13T05:20:56.874ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "79b38254-0540-4800-9dd4-a0cf0fc609bf", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62842025-02-13T05:20:56.874ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
62852025-02-13T05:20:56.874ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62862025-02-13T05:20:56.874ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4fc34fe-4e29-4f91-af17-09b997311a99", "content-length": "682", "date": "Thu, 13 Feb 2025 05:20:56 GMT"} })
62872025-02-13T05:20:56.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62882025-02-13T05:20:56.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62892025-02-13T05:20:56.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62902025-02-13T05:20:56.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62912025-02-13T05:20:56.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62922025-02-13T05:20:56.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62932025-02-13T05:20:56.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62942025-02-13T05:20:56.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62952025-02-13T05:20:56.892ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 653.081267ms iteration = 26 status = {}
62962025-02-13T05:20:57.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 06ac4c1c-ec58-411d-b618-0bbb28482494 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
62972025-02-13T05:20:57.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 06ac4c1c-ec58-411d-b618-0bbb28482494 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
62982025-02-13T05:20:57.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 06ac4c1c-ec58-411d-b618-0bbb28482494 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
62992025-02-13T05:20:58.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ab6fb54c-5c40-4cf3-9bc8-20b818a43637 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63002025-02-13T05:20:58.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ab6fb54c-5c40-4cf3-9bc8-20b818a43637 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63012025-02-13T05:20:58.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ab6fb54c-5c40-4cf3-9bc8-20b818a43637 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63022025-02-13T05:20:59.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cfcd3168-c9a7-4b3d-9026-b82cf5e843d0 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63032025-02-13T05:20:59.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cfcd3168-c9a7-4b3d-9026-b82cf5e843d0 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63042025-02-13T05:20:59.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = cfcd3168-c9a7-4b3d-9026-b82cf5e843d0 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63052025-02-13T05:21:00.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 484 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 7c03db52-0e5e-4d8b-9778-e3d78dce3d45 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
63062025-02-13T05:21:00.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4b693e67-87b4-4b60-9945-bb1912867b88 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63072025-02-13T05:21:00.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4b693e67-87b4-4b60-9945-bb1912867b88 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63082025-02-13T05:21:00.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4b693e67-87b4-4b60-9945-bb1912867b88 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63092025-02-13T05:21:01.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8720250b-fa37-4429-8a4c-bb4c379a4d3c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63102025-02-13T05:21:01.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8720250b-fa37-4429-8a4c-bb4c379a4d3c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63112025-02-13T05:21:01.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8720250b-fa37-4429-8a4c-bb4c379a4d3c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63122025-02-13T05:21:02.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 30cd1983-268e-43b3-969a-920ca05fc3da roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63132025-02-13T05:21:02.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 30cd1983-268e-43b3-969a-920ca05fc3da resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63142025-02-13T05:21:02.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2839 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 30cd1983-268e-43b3-969a-920ca05fc3da response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63152025-02-13T05:21:03.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7129610f-fd04-4a61-8fd8-b2b6f5ba60de roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63162025-02-13T05:21:03.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7129610f-fd04-4a61-8fd8-b2b6f5ba60de resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63172025-02-13T05:21:03.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7129610f-fd04-4a61-8fd8-b2b6f5ba60de response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63182025-02-13T05:21:04.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7add7056-225e-4444-b878-e4e05bd558ae roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63192025-02-13T05:21:04.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7add7056-225e-4444-b878-e4e05bd558ae resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63202025-02-13T05:21:04.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2570 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7add7056-225e-4444-b878-e4e05bd558ae response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63212025-02-13T05:21:05.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c20e0ab5-22f3-4676-9b6f-bda4e654c10f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63222025-02-13T05:21:05.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c20e0ab5-22f3-4676-9b6f-bda4e654c10f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63232025-02-13T05:21:05.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c20e0ab5-22f3-4676-9b6f-bda4e654c10f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63242025-02-13T05:21:06.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
63252025-02-13T05:21:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
63262025-02-13T05:21:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63272025-02-13T05:21:06.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63282025-02-13T05:21:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63292025-02-13T05:21:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63302025-02-13T05:21:06.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63312025-02-13T05:21:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63322025-02-13T05:21:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63332025-02-13T05:21:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63342025-02-13T05:21:06.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63352025-02-13T05:21:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63362025-02-13T05:21:06.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.710154ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63372025-02-13T05:21:06.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63382025-02-13T05:21:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63392025-02-13T05:21:06.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63402025-02-13T05:21:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
63412025-02-13T05:21:06.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63422025-02-13T05:21:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63432025-02-13T05:21:06.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
63442025-02-13T05:21:06.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.978763ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
63452025-02-13T05:21:06.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 41630125-5bc2-4bab-8156-e887b67e23da roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63462025-02-13T05:21:06.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 41630125-5bc2-4bab-8156-e887b67e23da resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63472025-02-13T05:21:06.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 41630125-5bc2-4bab-8156-e887b67e23da response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63482025-02-13T05:21:07.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2325f6d1-1ded-4bca-a8d8-41aa056ec1de roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63492025-02-13T05:21:07.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2325f6d1-1ded-4bca-a8d8-41aa056ec1de resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63502025-02-13T05:21:07.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2789 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2325f6d1-1ded-4bca-a8d8-41aa056ec1de response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63512025-02-13T05:21:08.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 90323b3f-244a-44af-8691-c51d2ee1b847 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63522025-02-13T05:21:08.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 90323b3f-244a-44af-8691-c51d2ee1b847 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63532025-02-13T05:21:08.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 90323b3f-244a-44af-8691-c51d2ee1b847 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63542025-02-13T05:21:09.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21760270-67d4-4d37-ba2f-54f37c283b9f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63552025-02-13T05:21:09.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21760270-67d4-4d37-ba2f-54f37c283b9f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63562025-02-13T05:21:09.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21760270-67d4-4d37-ba2f-54f37c283b9f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63572025-02-13T05:21:10.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 8a8da1be-fcc5-4295-bcec-0fca1cf690b4 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
63582025-02-13T05:21:10.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 8a8da1be-fcc5-4295-bcec-0fca1cf690b4 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
63592025-02-13T05:21:10.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3534 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 8a8da1be-fcc5-4295-bcec-0fca1cf690b4 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
63602025-02-13T05:21:10.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a3cae09a-4dbb-4ac5-8a7c-17fc2fca7883 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
63612025-02-13T05:21:10.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a3cae09a-4dbb-4ac5-8a7c-17fc2fca7883 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
63622025-02-13T05:21:10.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = a3cae09a-4dbb-4ac5-8a7c-17fc2fca7883 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
63632025-02-13T05:21:10.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 391 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 004a9ff1-0127-4fc9-bddf-4acf55d227a8 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
63642025-02-13T05:21:10.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a796603b-7656-49f9-95a4-4c248b5858a0 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63652025-02-13T05:21:10.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a796603b-7656-49f9-95a4-4c248b5858a0 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63662025-02-13T05:21:10.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a796603b-7656-49f9-95a4-4c248b5858a0 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63672025-02-13T05:21:11.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 821bdf1b-8f36-48de-a04f-93c3a2017476 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63682025-02-13T05:21:11.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 821bdf1b-8f36-48de-a04f-93c3a2017476 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63692025-02-13T05:21:11.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 821bdf1b-8f36-48de-a04f-93c3a2017476 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63702025-02-13T05:21:12.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8367cbed-950b-4ac5-bc2d-14326a2cd674 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63712025-02-13T05:21:12.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8367cbed-950b-4ac5-bc2d-14326a2cd674 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63722025-02-13T05:21:12.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8367cbed-950b-4ac5-bc2d-14326a2cd674 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63732025-02-13T05:21:13.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 73a4e92d-2580-4bfd-8b2e-3d701e7cf2ab roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63742025-02-13T05:21:13.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 73a4e92d-2580-4bfd-8b2e-3d701e7cf2ab resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63752025-02-13T05:21:13.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 73a4e92d-2580-4bfd-8b2e-3d701e7cf2ab response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63762025-02-13T05:21:14.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 774e26f2-89c9-4b5d-8259-7282cda91834 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63772025-02-13T05:21:14.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 774e26f2-89c9-4b5d-8259-7282cda91834 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63782025-02-13T05:21:14.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 774e26f2-89c9-4b5d-8259-7282cda91834 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63792025-02-13T05:21:15.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e44bb229-6440-40be-828a-6c75b268ea98 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63802025-02-13T05:21:15.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e44bb229-6440-40be-828a-6c75b268ea98 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63812025-02-13T05:21:15.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e44bb229-6440-40be-828a-6c75b268ea98 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
63822025-02-13T05:21:16.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
63832025-02-13T05:21:16.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
63842025-02-13T05:21:16.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63852025-02-13T05:21:16.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63862025-02-13T05:21:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63872025-02-13T05:21:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63882025-02-13T05:21:16.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63892025-02-13T05:21:16.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63902025-02-13T05:21:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63912025-02-13T05:21:16.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.357566ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63922025-02-13T05:21:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63932025-02-13T05:21:16.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63942025-02-13T05:21:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63952025-02-13T05:21:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63962025-02-13T05:21:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63972025-02-13T05:21:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63982025-02-13T05:21:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
63992025-02-13T05:21:16.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64002025-02-13T05:21:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64012025-02-13T05:21:16.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
64022025-02-13T05:21:16.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.720292ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
64032025-02-13T05:21:16.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 284e6e2c-a85d-4b26-9e1e-9a97b0ec811c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64042025-02-13T05:21:16.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 284e6e2c-a85d-4b26-9e1e-9a97b0ec811c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64052025-02-13T05:21:16.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1870 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 284e6e2c-a85d-4b26-9e1e-9a97b0ec811c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64062025-02-13T05:21:18.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9243f20-271b-47d7-89ab-c6dfd357fabd roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64072025-02-13T05:21:18.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9243f20-271b-47d7-89ab-c6dfd357fabd resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64082025-02-13T05:21:18.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2635 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9243f20-271b-47d7-89ab-c6dfd357fabd response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64092025-02-13T05:21:19.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8e4575e5-c32d-44c8-a892-f05477425201 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64102025-02-13T05:21:19.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8e4575e5-c32d-44c8-a892-f05477425201 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64112025-02-13T05:21:19.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8e4575e5-c32d-44c8-a892-f05477425201 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64122025-02-13T05:21:20.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9cca0ede-87ec-479c-b642-bd896db6695b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64132025-02-13T05:21:20.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9cca0ede-87ec-479c-b642-bd896db6695b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64142025-02-13T05:21:20.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9cca0ede-87ec-479c-b642-bd896db6695b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64152025-02-13T05:21:20.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 484 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = bb2bb7b0-2264-4235-8919-1f839a7046c8 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
64162025-02-13T05:21:21.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9411850-002e-470d-b54a-0de368f5b5f9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64172025-02-13T05:21:21.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9411850-002e-470d-b54a-0de368f5b5f9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64182025-02-13T05:21:21.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2524 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9411850-002e-470d-b54a-0de368f5b5f9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64192025-02-13T05:21:22.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 81def75b-49bd-41f2-abba-6f3abd99d189 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64202025-02-13T05:21:22.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 81def75b-49bd-41f2-abba-6f3abd99d189 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64212025-02-13T05:21:22.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 81def75b-49bd-41f2-abba-6f3abd99d189 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64222025-02-13T05:21:23.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5b5c426d-f782-47e8-9933-d9b290d26aae roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64232025-02-13T05:21:23.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5b5c426d-f782-47e8-9933-d9b290d26aae resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64242025-02-13T05:21:23.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2637 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5b5c426d-f782-47e8-9933-d9b290d26aae response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64252025-02-13T05:21:24.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3e3e3853-83f6-427f-b9ec-001f313ee40f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64262025-02-13T05:21:24.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3e3e3853-83f6-427f-b9ec-001f313ee40f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64272025-02-13T05:21:24.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3e3e3853-83f6-427f-b9ec-001f313ee40f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64282025-02-13T05:21:25.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 313e8858-9b45-43f2-b43c-da3a876eab94 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64292025-02-13T05:21:25.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 313e8858-9b45-43f2-b43c-da3a876eab94 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64302025-02-13T05:21:25.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 313e8858-9b45-43f2-b43c-da3a876eab94 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64312025-02-13T05:21:26.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d961d5e6-7e48-47ba-a426-bf15145aaae1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64322025-02-13T05:21:26.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d961d5e6-7e48-47ba-a426-bf15145aaae1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64332025-02-13T05:21:26.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d961d5e6-7e48-47ba-a426-bf15145aaae1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
64342025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
64352025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
64362025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
64372025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
64382025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
64392025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64402025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
64412025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64422025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
64432025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64442025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64452025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
64462025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
64472025-02-13T05:21:26.239ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64482025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64492025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
64502025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64512025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64522025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
64532025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
64542025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64552025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
64562025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64572025-02-13T05:21:26.239ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-13 05:11:26.239415117 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
64582025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
64592025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
64602025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
64612025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
64622025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64632025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
64642025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64652025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
64662025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
64672025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64682025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64692025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
64702025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
64712025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64722025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
64732025-02-13T05:21:26.239ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = e132683f-3ab0-4513-890f-86716ec9a9cf
64742025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
64752025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.281\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf"}
64762025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
64772025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64782025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64792025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
64802025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
64812025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64822025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
64832025-02-13T05:21:26.239ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
64842025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
64852025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64862025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
64872025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
64882025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64892025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
64902025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
64912025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
64922025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
64932025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64942025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
64952025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64962025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
64972025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64982025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
64992025-02-13T05:21:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65002025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
65012025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65022025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
65032025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65042025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65052025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65062025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65072025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
65082025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65092025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65102025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65112025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65122025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65132025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65142025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65152025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65162025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65172025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65182025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65192025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65202025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65212025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65222025-02-13T05:21:26.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec95727a-7af6-45d1-9962-81bf544db84b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 781509803 } })
65232025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65242025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
65252025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65262025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65272025-02-13T05:21:26.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9f4eb8b3-c464-433c-b912-c7432c124258.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cc24f910-ffb5-4de8-b7e1-4b9d4d15a7cd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 781535004 } })
65282025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
65292025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.174874ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
65302025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
65312025-02-13T05:21:26.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.236206ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
65322025-02-13T05:21:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65332025-02-13T05:21:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.536012ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
65342025-02-13T05:21:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65352025-02-13T05:21:26.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 784874899 } })
65362025-02-13T05:21:26.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
65372025-02-13T05:21:26.244ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.633892ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65382025-02-13T05:21:26.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65392025-02-13T05:21:26.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65402025-02-13T05:21:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65412025-02-13T05:21:26.246ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-13 05:11:26.239415117 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
65422025-02-13T05:21:26.246ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.691641ms iteration = 14 status = {"expiration":"2025-02-13T05:11:26.239415117Z","pruned":[]}
65432025-02-13T05:21:26.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 788218545 } })
65442025-02-13T05:21:26.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
65452025-02-13T05:21:26.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65462025-02-13T05:21:26.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65472025-02-13T05:21:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65482025-02-13T05:21:26.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65492025-02-13T05:21:26.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65502025-02-13T05:21:26.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65512025-02-13T05:21:26.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65522025-02-13T05:21:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65532025-02-13T05:21:26.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65542025-02-13T05:21:26.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65552025-02-13T05:21:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65562025-02-13T05:21:26.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65572025-02-13T05:21:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65582025-02-13T05:21:26.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65592025-02-13T05:21:26.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65602025-02-13T05:21:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65612025-02-13T05:21:26.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65622025-02-13T05:21:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65632025-02-13T05:21:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65642025-02-13T05:21:26.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65652025-02-13T05:21:26.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65662025-02-13T05:21:26.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65672025-02-13T05:21:26.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65682025-02-13T05:21:26.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65692025-02-13T05:21:26.270ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65702025-02-13T05:21:26.270ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65712025-02-13T05:21:26.270ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65722025-02-13T05:21:26.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65732025-02-13T05:21:26.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65742025-02-13T05:21:26.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65752025-02-13T05:21:26.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65762025-02-13T05:21:26.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
65772025-02-13T05:21:26.274ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65782025-02-13T05:21:26.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65792025-02-13T05:21:26.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65802025-02-13T05:21:26.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65812025-02-13T05:21:26.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65822025-02-13T05:21:26.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
65832025-02-13T05:21:26.274ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65842025-02-13T05:21:26.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65852025-02-13T05:21:26.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65862025-02-13T05:21:26.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65872025-02-13T05:21:26.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65882025-02-13T05:21:26.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65892025-02-13T05:21:26.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65902025-02-13T05:21:26.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65912025-02-13T05:21:26.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65922025-02-13T05:21:26.284ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
65932025-02-13T05:21:26.284ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
65942025-02-13T05:21:26.284ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
65952025-02-13T05:21:26.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65962025-02-13T05:21:26.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65972025-02-13T05:21:26.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65982025-02-13T05:21:26.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65992025-02-13T05:21:26.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66002025-02-13T05:21:26.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66012025-02-13T05:21:26.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66022025-02-13T05:21:26.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66032025-02-13T05:21:26.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66042025-02-13T05:21:26.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66052025-02-13T05:21:26.297ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 838300909 } })
66062025-02-13T05:21:26.297ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66072025-02-13T05:21:26.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66082025-02-13T05:21:26.298ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
66092025-02-13T05:21:26.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66102025-02-13T05:21:26.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66112025-02-13T05:21:26.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66122025-02-13T05:21:26.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66132025-02-13T05:21:26.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66142025-02-13T05:21:26.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
66152025-02-13T05:21:26.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66162025-02-13T05:21:26.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66172025-02-13T05:21:26.306ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 66.893213ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
66182025-02-13T05:21:26.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66192025-02-13T05:21:26.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66202025-02-13T05:21:26.313ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66212025-02-13T05:21:26.313ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66222025-02-13T05:21:26.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66232025-02-13T05:21:26.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66242025-02-13T05:21:26.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
66252025-02-13T05:21:26.313ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66262025-02-13T05:21:26.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66272025-02-13T05:21:26.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66282025-02-13T05:21:26.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66292025-02-13T05:21:26.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66302025-02-13T05:21:26.319ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66312025-02-13T05:21:26.319ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66322025-02-13T05:21:26.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66332025-02-13T05:21:26.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66342025-02-13T05:21:26.320ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 81.051215ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
66352025-02-13T05:21:26.321ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66362025-02-13T05:21:26.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66372025-02-13T05:21:26.332ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66382025-02-13T05:21:26.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66392025-02-13T05:21:26.335ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 95.408944ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
66402025-02-13T05:21:26.335ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
66412025-02-13T05:21:26.335ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.390161ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
66422025-02-13T05:21:26.335ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.438203ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66432025-02-13T05:21:26.345ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
66442025-02-13T05:21:26.345ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
66452025-02-13T05:21:26.346ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 106.319215ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
66462025-02-13T05:21:26.350ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
66472025-02-13T05:21:26.350ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
66482025-02-13T05:21:26.350ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
66492025-02-13T05:21:26.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66502025-02-13T05:21:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66512025-02-13T05:21:26.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66522025-02-13T05:21:26.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66532025-02-13T05:21:26.355ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66542025-02-13T05:21:26.356ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66552025-02-13T05:21:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66562025-02-13T05:21:26.356ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
66572025-02-13T05:21:26.359ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
66582025-02-13T05:21:26.359ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66592025-02-13T05:21:26.360ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3251ee0-ba58-4968-930c-09d40143f85d", "content-length": "26", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
66602025-02-13T05:21:26.360ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66612025-02-13T05:21:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66622025-02-13T05:21:26.360ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66632025-02-13T05:21:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66642025-02-13T05:21:26.360ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
66652025-02-13T05:21:26.360ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
66662025-02-13T05:21:26.360ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 121.361032ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
66672025-02-13T05:21:26.361ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66682025-02-13T05:21:26.362ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66692025-02-13T05:21:26.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66702025-02-13T05:21:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66712025-02-13T05:21:26.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 124.488511ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66722025-02-13T05:21:26.364ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66732025-02-13T05:21:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66742025-02-13T05:21:26.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
66752025-02-13T05:21:26.365ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66762025-02-13T05:21:26.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66772025-02-13T05:21:26.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66782025-02-13T05:21:26.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66792025-02-13T05:21:26.367ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66802025-02-13T05:21:26.369ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66812025-02-13T05:21:26.370ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66822025-02-13T05:21:26.370ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66832025-02-13T05:21:26.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66842025-02-13T05:21:26.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
66852025-02-13T05:21:26.372ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66862025-02-13T05:21:26.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66872025-02-13T05:21:26.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66882025-02-13T05:21:26.375ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 135.653039ms iteration = 27 status = 0
66892025-02-13T05:21:26.375ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66902025-02-13T05:21:26.375ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 136.191854ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66912025-02-13T05:21:26.375ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66922025-02-13T05:21:26.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66932025-02-13T05:21:26.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66942025-02-13T05:21:26.378ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66952025-02-13T05:21:26.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66962025-02-13T05:21:26.380ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66972025-02-13T05:21:26.380ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 0 version = 2
66982025-02-13T05:21:26.380ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66992025-02-13T05:21:26.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67002025-02-13T05:21:26.380ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67012025-02-13T05:21:26.382ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67022025-02-13T05:21:26.382ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67032025-02-13T05:21:26.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67042025-02-13T05:21:26.385ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67052025-02-13T05:21:26.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67062025-02-13T05:21:26.389ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67072025-02-13T05:21:26.389ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67082025-02-13T05:21:26.389ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.261264ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67092025-02-13T05:21:26.408ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 168.931895ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67102025-02-13T05:21:26.412ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
67112025-02-13T05:21:26.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 186.514285ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
67122025-02-13T05:21:26.433ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67132025-02-13T05:21:26.433ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67142025-02-13T05:21:26.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67152025-02-13T05:21:26.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67162025-02-13T05:21:26.441ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
67172025-02-13T05:21:26.441ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 201.815881ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
67182025-02-13T05:21:26.500ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
67192025-02-13T05:21:26.500ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67202025-02-13T05:21:26.500ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a89d3780-9769-4154-bf7a-753aa86e735c", "content-length": "26", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
67212025-02-13T05:21:26.500ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67222025-02-13T05:21:26.502ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
67232025-02-13T05:21:26.502ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67242025-02-13T05:21:26.503ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67252025-02-13T05:21:26.503ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7edc197b-5429-48fe-a91d-af1a25a28db0", "content-length": "26", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
67262025-02-13T05:21:26.503ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67272025-02-13T05:21:26.504ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 265.42244ms iteration = 29 status = {"physical_disks_added":0}
67282025-02-13T05:21:26.505ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
67292025-02-13T05:21:26.658ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67302025-02-13T05:21:26.659ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b78c73c-6bba-46fa-8bcc-8ac6b0abf557", "content-length": "691", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
67312025-02-13T05:21:26.659ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67322025-02-13T05:21:26.659ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
67332025-02-13T05:21:26.659ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
67342025-02-13T05:21:26.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67352025-02-13T05:21:26.660ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 421.401107ms iteration = 28 status = {}
67362025-02-13T05:21:26.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67372025-02-13T05:21:26.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67382025-02-13T05:21:26.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67392025-02-13T05:21:26.676ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67402025-02-13T05:21:26.676ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67412025-02-13T05:21:26.676ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "958e58b4-5ab8-4b08-a4df-52c4730b06d6", "content-length": "372", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
67422025-02-13T05:21:26.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67432025-02-13T05:21:26.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67442025-02-13T05:21:26.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67452025-02-13T05:21:26.680ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 1 version = 2
67462025-02-13T05:21:26.680ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
67472025-02-13T05:21:26.680ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-13 05:08:27.963644 UTC dns_group = external generation = 2
67482025-02-13T05:21:26.680ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 440.84722ms iteration = 14 status = {"generation":2}
67492025-02-13T05:21:26.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67502025-02-13T05:21:26.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67512025-02-13T05:21:26.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67522025-02-13T05:21:26.683ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 444.431062ms iteration = 27 status = {}
67532025-02-13T05:21:26.687ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
67542025-02-13T05:21:26.689ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
67552025-02-13T05:21:26.689ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67562025-02-13T05:21:26.689ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-13 05:08:26.528706 UTC dns_group = internal generation = 1
67572025-02-13T05:21:26.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 449.757143ms iteration = 14 status = {"generation":1}
67582025-02-13T05:21:26.720ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-13T05:08:23.439194Z, time_modified: 2025-02-13T05:08:23.439194Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }) }
67592025-02-13T05:21:26.720ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 480.909829ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]}},"default_endpoint":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
67602025-02-13T05:21:26.739ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
67612025-02-13T05:21:26.740ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3a3df2a1-c35d-40e2-bcf6-16296b69545a", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
67622025-02-13T05:21:26.740ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
67632025-02-13T05:21:26.740ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
67642025-02-13T05:21:26.740ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67652025-02-13T05:21:26.740ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8f43926b-1ada-4f27-a850-d3f2d9a0e6cf", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
67662025-02-13T05:21:26.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67672025-02-13T05:21:26.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67682025-02-13T05:21:26.741ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "03a31c1b-1268-430f-beb9-643eff9309dd", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
67692025-02-13T05:21:26.741ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
67702025-02-13T05:21:26.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67712025-02-13T05:21:26.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67722025-02-13T05:21:26.744ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
67732025-02-13T05:21:26.744ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 504.413638ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
67742025-02-13T05:21:26.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67752025-02-13T05:21:26.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67762025-02-13T05:21:26.751ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67772025-02-13T05:21:26.751ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67782025-02-13T05:21:26.751ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "47b0f8e8-2124-439a-8dba-5bdfff77c4a1", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
67792025-02-13T05:21:26.754ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 514.979528ms iteration = 28 status = {}
67802025-02-13T05:21:26.756ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
67812025-02-13T05:21:26.756ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 516.651606ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
67822025-02-13T05:21:26.756ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67832025-02-13T05:21:26.757ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9016fb76-3ab8-42ed-a3f5-725f4c29d134", "content-length": "2", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
67842025-02-13T05:21:26.758ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67852025-02-13T05:21:26.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67862025-02-13T05:21:26.760ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 521.35978ms iteration = 27 status = null
67872025-02-13T05:21:26.781ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
67882025-02-13T05:21:26.781ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5f8b655a-2f27-479e-9141-7fadcc1d2584", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67892025-02-13T05:21:26.781ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67902025-02-13T05:21:26.783ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d8510732-b331-4421-b837-b0fa31ec40b1", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67912025-02-13T05:21:26.783ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67922025-02-13T05:21:26.784ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d59211bf-de42-4782-bd53-6200f4660121", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67932025-02-13T05:21:26.784ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67942025-02-13T05:21:26.786ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67952025-02-13T05:21:26.786ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 547.255767ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
67962025-02-13T05:21:26.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67972025-02-13T05:21:26.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67982025-02-13T05:21:26.831ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
67992025-02-13T05:21:26.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68002025-02-13T05:21:26.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68012025-02-13T05:21:26.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68022025-02-13T05:21:26.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "87b29a10-b192-4918-94d5-4e1b997c8f0a", "content-length": "134", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
68032025-02-13T05:21:26.841ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68042025-02-13T05:21:26.841ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
68052025-02-13T05:21:26.841ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68062025-02-13T05:21:26.841ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68072025-02-13T05:21:26.841ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68082025-02-13T05:21:26.841ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68092025-02-13T05:21:26.841ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68102025-02-13T05:21:26.841ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68112025-02-13T05:21:26.841ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68122025-02-13T05:21:26.841ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68132025-02-13T05:21:26.842ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
68142025-02-13T05:21:26.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68152025-02-13T05:21:26.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68162025-02-13T05:21:26.844ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68172025-02-13T05:21:26.844ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "569a6676-b9b7-42d2-99bf-559da1a7a42d", "content-length": "2", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
68182025-02-13T05:21:26.844ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68192025-02-13T05:21:26.844ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "66e58875-d1b3-4419-b9a1-86802024a452", "content-length": "52", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
68202025-02-13T05:21:26.844ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
68212025-02-13T05:21:26.844ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68222025-02-13T05:21:27.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "20a01d12-0181-40ca-a143-156ecf39ab07", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
68232025-02-13T05:21:27.037ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
68242025-02-13T05:21:27.037ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68252025-02-13T05:21:27.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "37c1da18-e6a4-4752-abca-27ad288904c8", "content-length": "682", "date": "Thu, 13 Feb 2025 05:21:26 GMT"} })
68262025-02-13T05:21:27.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68272025-02-13T05:21:27.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68282025-02-13T05:21:27.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68292025-02-13T05:21:27.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68302025-02-13T05:21:27.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68312025-02-13T05:21:27.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68322025-02-13T05:21:27.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68332025-02-13T05:21:27.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68342025-02-13T05:21:27.054ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 815.302201ms iteration = 27 status = {}
68352025-02-13T05:21:27.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 32d92b94-a41c-4b92-9e5f-e414b4a0b6e7 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68362025-02-13T05:21:27.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 32d92b94-a41c-4b92-9e5f-e414b4a0b6e7 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68372025-02-13T05:21:27.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 32d92b94-a41c-4b92-9e5f-e414b4a0b6e7 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68382025-02-13T05:21:28.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2f7f8d48-e214-4764-9cc6-919788edc341 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68392025-02-13T05:21:28.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2f7f8d48-e214-4764-9cc6-919788edc341 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68402025-02-13T05:21:28.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2801 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2f7f8d48-e214-4764-9cc6-919788edc341 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68412025-02-13T05:21:29.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4a85d1f7-9763-4ae6-99d1-9240998843ba roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68422025-02-13T05:21:29.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4a85d1f7-9763-4ae6-99d1-9240998843ba resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68432025-02-13T05:21:29.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2679 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4a85d1f7-9763-4ae6-99d1-9240998843ba response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68442025-02-13T05:21:30.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 495 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = b2eba581-4311-4df6-ab5a-c33ec7a435b3 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
68452025-02-13T05:21:30.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21efc7a4-aa2a-4e92-9269-20cea08b0d68 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68462025-02-13T05:21:30.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21efc7a4-aa2a-4e92-9269-20cea08b0d68 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68472025-02-13T05:21:30.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 21efc7a4-aa2a-4e92-9269-20cea08b0d68 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68482025-02-13T05:21:31.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1f30a83b-e2db-4736-938a-a3ff6465f276 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68492025-02-13T05:21:31.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1f30a83b-e2db-4736-938a-a3ff6465f276 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68502025-02-13T05:21:31.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1f30a83b-e2db-4736-938a-a3ff6465f276 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68512025-02-13T05:21:32.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7f814169-c374-4074-a126-219d7705eb98 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68522025-02-13T05:21:32.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7f814169-c374-4074-a126-219d7705eb98 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68532025-02-13T05:21:32.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1888 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7f814169-c374-4074-a126-219d7705eb98 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68542025-02-13T05:21:33.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 567e8eba-8d96-4c3e-a94e-fb11e1ef4e73 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68552025-02-13T05:21:33.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 567e8eba-8d96-4c3e-a94e-fb11e1ef4e73 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68562025-02-13T05:21:33.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 567e8eba-8d96-4c3e-a94e-fb11e1ef4e73 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68572025-02-13T05:21:34.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e356ff04-4f96-4ac9-b290-816fc642e9f1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68582025-02-13T05:21:34.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e356ff04-4f96-4ac9-b290-816fc642e9f1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68592025-02-13T05:21:34.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2616 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e356ff04-4f96-4ac9-b290-816fc642e9f1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68602025-02-13T05:21:35.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b009aef3-3877-4c66-a6e2-ba74db04ca7b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68612025-02-13T05:21:35.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b009aef3-3877-4c66-a6e2-ba74db04ca7b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68622025-02-13T05:21:35.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b009aef3-3877-4c66-a6e2-ba74db04ca7b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68632025-02-13T05:21:36.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
68642025-02-13T05:21:36.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
68652025-02-13T05:21:36.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68662025-02-13T05:21:36.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68672025-02-13T05:21:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68682025-02-13T05:21:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68692025-02-13T05:21:36.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68702025-02-13T05:21:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68712025-02-13T05:21:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68722025-02-13T05:21:36.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.423176ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68732025-02-13T05:21:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68742025-02-13T05:21:36.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68752025-02-13T05:21:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68762025-02-13T05:21:36.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68772025-02-13T05:21:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68782025-02-13T05:21:36.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68792025-02-13T05:21:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
68802025-02-13T05:21:36.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68812025-02-13T05:21:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68822025-02-13T05:21:36.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
68832025-02-13T05:21:36.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.032983ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
68842025-02-13T05:21:36.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96912efc-edb8-4133-92d9-4556ae07a8ab roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68852025-02-13T05:21:36.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96912efc-edb8-4133-92d9-4556ae07a8ab resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68862025-02-13T05:21:36.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1703 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 96912efc-edb8-4133-92d9-4556ae07a8ab response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68872025-02-13T05:21:37.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 80dff1a5-5948-48d0-8951-35d7ccf1f262 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68882025-02-13T05:21:37.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 80dff1a5-5948-48d0-8951-35d7ccf1f262 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68892025-02-13T05:21:37.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2138 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 80dff1a5-5948-48d0-8951-35d7ccf1f262 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68902025-02-13T05:21:38.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09b2ecd9-eb31-4b7f-b643-16663cffe074 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68912025-02-13T05:21:38.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09b2ecd9-eb31-4b7f-b643-16663cffe074 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68922025-02-13T05:21:38.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09b2ecd9-eb31-4b7f-b643-16663cffe074 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68932025-02-13T05:21:39.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 87d69a32-c111-44e2-9f18-479f819b6552 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68942025-02-13T05:21:39.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 87d69a32-c111-44e2-9f18-479f819b6552 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68952025-02-13T05:21:39.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2164 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 87d69a32-c111-44e2-9f18-479f819b6552 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68962025-02-13T05:21:40.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 453 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 27127683-cb5b-4f4e-95ff-a03770b365f9 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
68972025-02-13T05:21:40.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dbf6fd26-9c83-4437-b685-7a03a8f5b8db roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68982025-02-13T05:21:40.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dbf6fd26-9c83-4437-b685-7a03a8f5b8db resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
68992025-02-13T05:21:40.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dbf6fd26-9c83-4437-b685-7a03a8f5b8db response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69002025-02-13T05:21:41.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5aa4c87c-5035-44d5-a573-2a1b28d40b13 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69012025-02-13T05:21:41.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5aa4c87c-5035-44d5-a573-2a1b28d40b13 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69022025-02-13T05:21:41.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1853 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 5aa4c87c-5035-44d5-a573-2a1b28d40b13 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69032025-02-13T05:21:42.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d8d82d20-c94f-4985-9db3-8378a1ea83d9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69042025-02-13T05:21:42.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d8d82d20-c94f-4985-9db3-8378a1ea83d9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69052025-02-13T05:21:42.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2626 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d8d82d20-c94f-4985-9db3-8378a1ea83d9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69062025-02-13T05:21:43.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4cddc64d-6c47-48c0-9983-ae3d2a24a0c5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69072025-02-13T05:21:43.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4cddc64d-6c47-48c0-9983-ae3d2a24a0c5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69082025-02-13T05:21:43.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4cddc64d-6c47-48c0-9983-ae3d2a24a0c5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69092025-02-13T05:21:44.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 55e92bac-8b54-469d-8a6e-39c008f67d84 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69102025-02-13T05:21:44.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 55e92bac-8b54-469d-8a6e-39c008f67d84 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69112025-02-13T05:21:44.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 55e92bac-8b54-469d-8a6e-39c008f67d84 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69122025-02-13T05:21:45.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f93bf27b-f950-4fe2-848e-8865b1607ae2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69132025-02-13T05:21:45.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f93bf27b-f950-4fe2-848e-8865b1607ae2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69142025-02-13T05:21:45.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f93bf27b-f950-4fe2-848e-8865b1607ae2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69152025-02-13T05:21:46.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
69162025-02-13T05:21:46.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69172025-02-13T05:21:46.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
69182025-02-13T05:21:46.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69192025-02-13T05:21:46.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69202025-02-13T05:21:46.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69212025-02-13T05:21:46.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69222025-02-13T05:21:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69232025-02-13T05:21:46.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69242025-02-13T05:21:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69252025-02-13T05:21:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69262025-02-13T05:21:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69272025-02-13T05:21:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69282025-02-13T05:21:46.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69292025-02-13T05:21:46.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69302025-02-13T05:21:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
69312025-02-13T05:21:46.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69322025-02-13T05:21:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69332025-02-13T05:21:46.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
69342025-02-13T05:21:46.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.170217ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
69352025-02-13T05:21:46.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.844802ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69362025-02-13T05:21:46.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e8babd2c-901c-453e-b5bc-441aff5fb118 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69372025-02-13T05:21:46.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e8babd2c-901c-453e-b5bc-441aff5fb118 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69382025-02-13T05:21:46.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e8babd2c-901c-453e-b5bc-441aff5fb118 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69392025-02-13T05:21:47.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6919022e-0ef7-4eb7-bf5d-7e8844956e21 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69402025-02-13T05:21:47.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6919022e-0ef7-4eb7-bf5d-7e8844956e21 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69412025-02-13T05:21:47.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6919022e-0ef7-4eb7-bf5d-7e8844956e21 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69422025-02-13T05:21:48.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 505f5472-44e5-41b2-9821-201f4690beae roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69432025-02-13T05:21:48.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 505f5472-44e5-41b2-9821-201f4690beae resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69442025-02-13T05:21:48.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 505f5472-44e5-41b2-9821-201f4690beae response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69452025-02-13T05:21:49.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4212bd8c-a040-454f-b11a-502405c56d2d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69462025-02-13T05:21:49.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4212bd8c-a040-454f-b11a-502405c56d2d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69472025-02-13T05:21:49.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2474 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4212bd8c-a040-454f-b11a-502405c56d2d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69482025-02-13T05:21:50.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 495 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = de9a3053-9be6-4616-b7b4-48dae5699539 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
69492025-02-13T05:21:50.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9b03c6f6-a121-40ba-beb3-242ce2740c05 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69502025-02-13T05:21:50.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9b03c6f6-a121-40ba-beb3-242ce2740c05 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69512025-02-13T05:21:50.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9b03c6f6-a121-40ba-beb3-242ce2740c05 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69522025-02-13T05:21:51.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 34501d85-8645-4457-b5da-64d2f85eda7b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69532025-02-13T05:21:51.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 34501d85-8645-4457-b5da-64d2f85eda7b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69542025-02-13T05:21:51.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 34501d85-8645-4457-b5da-64d2f85eda7b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69552025-02-13T05:21:52.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9cbcee7-9f2d-4964-a608-4d05a640afc2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69562025-02-13T05:21:52.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9cbcee7-9f2d-4964-a608-4d05a640afc2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69572025-02-13T05:21:52.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b9cbcee7-9f2d-4964-a608-4d05a640afc2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69582025-02-13T05:21:53.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09a6090a-4358-43a3-91d8-204e0f2cab89 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69592025-02-13T05:21:53.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09a6090a-4358-43a3-91d8-204e0f2cab89 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69602025-02-13T05:21:53.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 09a6090a-4358-43a3-91d8-204e0f2cab89 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69612025-02-13T05:21:54.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4bec7b92-5a77-4275-b3e2-92944340c9fc roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69622025-02-13T05:21:54.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4bec7b92-5a77-4275-b3e2-92944340c9fc resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69632025-02-13T05:21:54.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2662 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4bec7b92-5a77-4275-b3e2-92944340c9fc response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69642025-02-13T05:21:55.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e7ce33c8-d01c-4aec-87a9-014549019e88 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69652025-02-13T05:21:55.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e7ce33c8-d01c-4aec-87a9-014549019e88 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69662025-02-13T05:21:55.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e7ce33c8-d01c-4aec-87a9-014549019e88 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
69672025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
69682025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69692025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
69702025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
69712025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69722025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69732025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
69742025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69752025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
69762025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69772025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
69782025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 28 reason = Timeout
69792025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
69802025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69812025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
69822025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
69832025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69842025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69852025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
69862025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69872025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
69882025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69892025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
69902025-02-13T05:21:56.238ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69912025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69922025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
69932025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69942025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
69952025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69962025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
69972025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69982025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
69992025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70002025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70012025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
70022025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70032025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
70042025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70052025-02-13T05:21:56.238ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
70062025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70072025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70082025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70092025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70102025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70112025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70122025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70132025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
70142025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70152025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70162025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70172025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70182025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70192025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70202025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70212025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70222025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70232025-02-13T05:21:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70242025-02-13T05:21:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70252025-02-13T05:21:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70262025-02-13T05:21:56.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 783531981 } })
70272025-02-13T05:21:56.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
70282025-02-13T05:21:56.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70292025-02-13T05:21:56.242ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.070036ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70302025-02-13T05:21:56.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 784971402 } })
70312025-02-13T05:21:56.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
70322025-02-13T05:21:56.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70332025-02-13T05:21:56.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70342025-02-13T05:21:56.244ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70352025-02-13T05:21:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70362025-02-13T05:21:56.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70372025-02-13T05:21:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70382025-02-13T05:21:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70392025-02-13T05:21:56.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70402025-02-13T05:21:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70412025-02-13T05:21:56.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70422025-02-13T05:21:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70432025-02-13T05:21:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70442025-02-13T05:21:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70452025-02-13T05:21:56.248ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70462025-02-13T05:21:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70472025-02-13T05:21:56.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.604012ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
70482025-02-13T05:21:56.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70492025-02-13T05:21:56.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70502025-02-13T05:21:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70512025-02-13T05:21:56.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70522025-02-13T05:21:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70532025-02-13T05:21:56.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70542025-02-13T05:21:56.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70552025-02-13T05:21:56.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70562025-02-13T05:21:56.254ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70572025-02-13T05:21:56.254ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70582025-02-13T05:21:56.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70592025-02-13T05:21:56.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70602025-02-13T05:21:56.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70612025-02-13T05:21:56.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70622025-02-13T05:21:56.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70632025-02-13T05:21:56.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70642025-02-13T05:21:56.257ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 799332510 } })
70652025-02-13T05:21:56.258ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
70662025-02-13T05:21:56.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70672025-02-13T05:21:56.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70682025-02-13T05:21:56.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70692025-02-13T05:21:56.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
70702025-02-13T05:21:56.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70712025-02-13T05:21:56.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70722025-02-13T05:21:56.305ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
70732025-02-13T05:21:56.305ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.759359ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
70742025-02-13T05:21:56.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70752025-02-13T05:21:56.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70762025-02-13T05:21:56.309ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.67467ms iteration = 28 status = {"errors":[],"requests_created_ok":[]}
70772025-02-13T05:21:56.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70782025-02-13T05:21:56.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70792025-02-13T05:21:56.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70802025-02-13T05:21:56.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70812025-02-13T05:21:56.317ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70822025-02-13T05:21:56.317ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70832025-02-13T05:21:56.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70842025-02-13T05:21:56.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.708689ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
70852025-02-13T05:21:56.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70862025-02-13T05:21:56.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.094268ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70872025-02-13T05:21:56.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.014474ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70882025-02-13T05:21:56.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70892025-02-13T05:21:56.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70902025-02-13T05:21:56.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70912025-02-13T05:21:56.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70922025-02-13T05:21:56.320ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70932025-02-13T05:21:56.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70942025-02-13T05:21:56.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
70952025-02-13T05:21:56.321ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70962025-02-13T05:21:56.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70972025-02-13T05:21:56.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70982025-02-13T05:21:56.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70992025-02-13T05:21:56.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71002025-02-13T05:21:56.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71012025-02-13T05:21:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71022025-02-13T05:21:56.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71032025-02-13T05:21:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71042025-02-13T05:21:56.325ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71052025-02-13T05:21:56.325ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71062025-02-13T05:21:56.325ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71072025-02-13T05:21:56.325ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.554322ms iteration = 28 status = 0
71082025-02-13T05:21:56.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71092025-02-13T05:21:56.327ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71102025-02-13T05:21:56.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71112025-02-13T05:21:56.334ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.844237ms iteration = 30 status = {"physical_disks_added":0}
71122025-02-13T05:21:56.335ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
71132025-02-13T05:21:56.335ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71142025-02-13T05:21:56.335ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a840f6bf-079a-4bd0-a58c-5e810e1aa35a", "content-length": "26", "date": "Thu, 13 Feb 2025 05:21:56 GMT"} })
71152025-02-13T05:21:56.335ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71162025-02-13T05:21:56.337ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71172025-02-13T05:21:56.348ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
71182025-02-13T05:21:56.348ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71192025-02-13T05:21:56.348ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87769abb-2e3a-4f20-aa45-a165202be0e2", "content-length": "26", "date": "Thu, 13 Feb 2025 05:21:56 GMT"} })
71202025-02-13T05:21:56.348ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71212025-02-13T05:21:56.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71222025-02-13T05:21:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71232025-02-13T05:21:56.350ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
71242025-02-13T05:21:56.351ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
71252025-02-13T05:21:56.351ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71262025-02-13T05:21:56.351ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98574ea6-95b8-43ef-bc49-80345e07ec0a", "content-length": "26", "date": "Thu, 13 Feb 2025 05:21:56 GMT"} })
71272025-02-13T05:21:56.351ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71282025-02-13T05:21:56.353ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71292025-02-13T05:21:56.353ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.710863ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71302025-02-13T05:21:56.356ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71312025-02-13T05:21:56.356ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71322025-02-13T05:21:56.356ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.41054ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71332025-02-13T05:21:56.359ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71342025-02-13T05:21:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
71352025-02-13T05:21:56.361ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71362025-02-13T05:21:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71372025-02-13T05:21:56.363ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
71382025-02-13T05:21:56.363ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 124.368138ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
71392025-02-13T05:21:56.372ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71402025-02-13T05:21:56.372ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 133.60389ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71412025-02-13T05:21:56.383ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 144.15409ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71422025-02-13T05:21:56.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71432025-02-13T05:21:56.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71442025-02-13T05:21:56.525ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71452025-02-13T05:21:56.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71462025-02-13T05:21:56.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71472025-02-13T05:21:56.528ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71482025-02-13T05:21:56.528ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71492025-02-13T05:21:56.528ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6a71b79-f3b6-459d-b597-1087ea072c45", "content-length": "372", "date": "Thu, 13 Feb 2025 05:21:56 GMT"} })
71502025-02-13T05:21:56.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71512025-02-13T05:21:56.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71522025-02-13T05:21:56.530ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71532025-02-13T05:21:56.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71542025-02-13T05:21:56.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71552025-02-13T05:21:56.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71562025-02-13T05:21:56.534ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71572025-02-13T05:21:56.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71582025-02-13T05:21:56.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71592025-02-13T05:21:56.565ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71602025-02-13T05:21:56.566ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "11f8c7e6-bbb0-4e2b-a472-f04ce5499618", "content-length": "2", "date": "Thu, 13 Feb 2025 05:21:55 GMT"} })
71612025-02-13T05:21:56.567ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71622025-02-13T05:21:56.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71632025-02-13T05:21:56.570ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 331.86715ms iteration = 28 status = null
71642025-02-13T05:21:56.570ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 332.100616ms iteration = 28 status = {}
71652025-02-13T05:21:56.579ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
71662025-02-13T05:21:56.579ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71672025-02-13T05:21:56.579ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b1eb4819-e31f-4bbd-8cfd-15f69ded84a7", "date": "Thu, 13 Feb 2025 05:21:56 GMT"} })
71682025-02-13T05:21:56.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71692025-02-13T05:21:56.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71702025-02-13T05:21:56.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71712025-02-13T05:21:56.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71722025-02-13T05:21:56.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71732025-02-13T05:21:56.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71742025-02-13T05:21:56.588ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71752025-02-13T05:21:56.588ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71762025-02-13T05:21:56.588ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a82045bb-96ce-4d84-8a98-42b551b625ba", "date": "Thu, 13 Feb 2025 05:21:56 GMT"} })
71772025-02-13T05:21:56.590ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 352.110045ms iteration = 29 status = {}
71782025-02-13T05:21:56.612ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
71792025-02-13T05:21:56.612ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9109f819-290c-4d7b-b424-84b52cba0520", "content-length": "691", "date": "Thu, 13 Feb 2025 05:21:56 GMT"} })
71802025-02-13T05:21:56.612ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
71812025-02-13T05:21:56.612ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
71822025-02-13T05:21:56.612ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
71832025-02-13T05:21:56.614ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 375.663596ms iteration = 29 status = {}
71842025-02-13T05:21:56.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71852025-02-13T05:21:56.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71862025-02-13T05:21:56.635ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
71872025-02-13T05:21:56.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71882025-02-13T05:21:56.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71892025-02-13T05:21:56.645ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71902025-02-13T05:21:56.646ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea0a3ac0-b291-47f5-82d1-41c2b3250a03", "content-length": "134", "date": "Thu, 13 Feb 2025 05:21:55 GMT"} })
71912025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
71922025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
71932025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
71942025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71952025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71962025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71972025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71982025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71992025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72002025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72012025-02-13T05:21:56.646ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
72022025-02-13T05:21:56.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72032025-02-13T05:21:56.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72042025-02-13T05:21:56.649ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72052025-02-13T05:21:56.649ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ad9204e-804b-48e3-acee-ec5473e71b04", "content-length": "2", "date": "Thu, 13 Feb 2025 05:21:55 GMT"} })
72062025-02-13T05:21:56.649ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72072025-02-13T05:21:56.649ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "63818c7f-eb86-4971-9763-dd9d0bedd1f3", "content-length": "52", "date": "Thu, 13 Feb 2025 05:21:55 GMT"} })
72082025-02-13T05:21:56.649ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
72092025-02-13T05:21:56.649ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72102025-02-13T05:21:56.734ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "56ef7eef-d0bc-459a-8754-30e83af87cb7", "date": "Thu, 13 Feb 2025 05:21:56 GMT"} })
72112025-02-13T05:21:56.734ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
72122025-02-13T05:21:56.734ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72132025-02-13T05:21:56.734ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "47a3a7fa-8304-4a4c-93d1-e4baa17a9185", "content-length": "682", "date": "Thu, 13 Feb 2025 05:21:56 GMT"} })
72142025-02-13T05:21:56.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72152025-02-13T05:21:56.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72162025-02-13T05:21:56.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72172025-02-13T05:21:56.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72182025-02-13T05:21:56.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72192025-02-13T05:21:56.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72202025-02-13T05:21:56.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72212025-02-13T05:21:56.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72222025-02-13T05:21:56.752ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 514.135014ms iteration = 28 status = {}
72232025-02-13T05:21:56.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8600e5e0-c2dd-45c5-baf4-55243c515186 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72242025-02-13T05:21:56.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8600e5e0-c2dd-45c5-baf4-55243c515186 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72252025-02-13T05:21:56.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8600e5e0-c2dd-45c5-baf4-55243c515186 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72262025-02-13T05:21:57.166ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
72272025-02-13T05:21:57.166ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
72282025-02-13T05:21:57.197ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
72292025-02-13T05:21:57.197ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:61133
72302025-02-13T05:21:57.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:61133 req_id = f21989c7-2223-4446-979a-cada8aabe9f5 roles = RoleSet { roles: {} } uri = /metrics/producers
72312025-02-13T05:21:57.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:61133 req_id = f21989c7-2223-4446-979a-cada8aabe9f5 resource = Database result = Ok(()) uri = /metrics/producers
72322025-02-13T05:21:57.234ZINFOnexus: assigned collector to new producer collector_id = 93aa177d-6d80-4ea9-988c-9de41b46fd8d file = nexus/src/app/oximeter.rs:76 producer_id = a8269f60-9104-4275-9edc-a31614d5c23e
72332025-02-13T05:21:57.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37100 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:61133 req_id = f21989c7-2223-4446-979a-cada8aabe9f5 response_code = 201 uri = /metrics/producers
72342025-02-13T05:21:57.234ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f21989c7-2223-4446-979a-cada8aabe9f5", "content-length": "41", "date": "Thu, 13 Feb 2025 05:21:56 GMT"} })
72352025-02-13T05:21:57.236ZDEBGnexus (producer-registration-task): registered with nexus successfully
72362025-02-13T05:21:57.236ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
72372025-02-13T05:21:57.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b58a2657-8854-40c8-9e86-9c338488704e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72382025-02-13T05:21:57.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b58a2657-8854-40c8-9e86-9c338488704e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72392025-02-13T05:21:57.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2527 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b58a2657-8854-40c8-9e86-9c338488704e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72402025-02-13T05:21:58.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a6f3cb31-407c-494f-8867-6f312ba5dada roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72412025-02-13T05:21:58.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a6f3cb31-407c-494f-8867-6f312ba5dada resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72422025-02-13T05:21:58.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a6f3cb31-407c-494f-8867-6f312ba5dada response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72432025-02-13T05:21:59.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9eb849b9-d874-4f1f-85a9-674ef500b807 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72442025-02-13T05:21:59.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9eb849b9-d874-4f1f-85a9-674ef500b807 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72452025-02-13T05:21:59.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3255 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9eb849b9-d874-4f1f-85a9-674ef500b807 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72462025-02-13T05:22:00.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 94f72efe-208f-4559-8549-a819478da82b response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
72472025-02-13T05:22:00.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dc6960ef-f36a-4138-81ec-893218caae80 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72482025-02-13T05:22:00.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dc6960ef-f36a-4138-81ec-893218caae80 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72492025-02-13T05:22:00.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = dc6960ef-f36a-4138-81ec-893218caae80 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72502025-02-13T05:22:01.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b802efc3-6b81-4630-b67b-2c57b5e16eaa roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72512025-02-13T05:22:01.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b802efc3-6b81-4630-b67b-2c57b5e16eaa resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72522025-02-13T05:22:01.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2538 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b802efc3-6b81-4630-b67b-2c57b5e16eaa response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72532025-02-13T05:22:02.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a4a122a7-3f43-4b39-af00-e187354f7110 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72542025-02-13T05:22:02.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a4a122a7-3f43-4b39-af00-e187354f7110 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72552025-02-13T05:22:02.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2239 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a4a122a7-3f43-4b39-af00-e187354f7110 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72562025-02-13T05:22:04.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ae2badca-ecea-4a57-94a8-57c0d5672bdf roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72572025-02-13T05:22:04.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ae2badca-ecea-4a57-94a8-57c0d5672bdf resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72582025-02-13T05:22:04.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ae2badca-ecea-4a57-94a8-57c0d5672bdf response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72592025-02-13T05:22:05.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4ed900ca-afa2-4c4b-83a6-c3da9d3868d0 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72602025-02-13T05:22:05.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4ed900ca-afa2-4c4b-83a6-c3da9d3868d0 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72612025-02-13T05:22:05.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4ed900ca-afa2-4c4b-83a6-c3da9d3868d0 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72622025-02-13T05:22:06.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 879d93cd-b20d-4f6f-83b4-72117bb60b63 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72632025-02-13T05:22:06.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 879d93cd-b20d-4f6f-83b4-72117bb60b63 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72642025-02-13T05:22:06.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 879d93cd-b20d-4f6f-83b4-72117bb60b63 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72652025-02-13T05:22:06.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
72662025-02-13T05:22:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
72672025-02-13T05:22:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72682025-02-13T05:22:06.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72692025-02-13T05:22:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72702025-02-13T05:22:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72712025-02-13T05:22:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72722025-02-13T05:22:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72732025-02-13T05:22:06.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72742025-02-13T05:22:06.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.516568ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72752025-02-13T05:22:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72762025-02-13T05:22:06.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72772025-02-13T05:22:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72782025-02-13T05:22:06.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72792025-02-13T05:22:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72802025-02-13T05:22:06.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72812025-02-13T05:22:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
72822025-02-13T05:22:06.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72832025-02-13T05:22:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72842025-02-13T05:22:06.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
72852025-02-13T05:22:06.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.845613ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
72862025-02-13T05:22:07.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a2fd142b-607f-4b0a-843f-96b03110f4c4 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72872025-02-13T05:22:07.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a2fd142b-607f-4b0a-843f-96b03110f4c4 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72882025-02-13T05:22:07.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2736 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a2fd142b-607f-4b0a-843f-96b03110f4c4 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72892025-02-13T05:22:08.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = eb25ea11-dbc1-43ea-a217-d7cc66ccc4b5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72902025-02-13T05:22:08.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = eb25ea11-dbc1-43ea-a217-d7cc66ccc4b5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72912025-02-13T05:22:08.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1842 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = eb25ea11-dbc1-43ea-a217-d7cc66ccc4b5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72922025-02-13T05:22:09.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8bdfbdbc-aa7e-4ed7-82d1-bdf2a44b3c87 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72932025-02-13T05:22:09.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8bdfbdbc-aa7e-4ed7-82d1-bdf2a44b3c87 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72942025-02-13T05:22:09.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8bdfbdbc-aa7e-4ed7-82d1-bdf2a44b3c87 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72952025-02-13T05:22:10.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e6c4b34b-def6-422d-a3b7-74ba127b1245 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72962025-02-13T05:22:10.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e6c4b34b-def6-422d-a3b7-74ba127b1245 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72972025-02-13T05:22:10.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e6c4b34b-def6-422d-a3b7-74ba127b1245 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
72982025-02-13T05:22:10.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 428 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = a6c24b53-fa85-45c1-9230-f65073d36e75 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
72992025-02-13T05:22:11.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 222a35d2-b59e-45ed-8448-9a19951d4c58 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73002025-02-13T05:22:11.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 222a35d2-b59e-45ed-8448-9a19951d4c58 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73012025-02-13T05:22:11.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 222a35d2-b59e-45ed-8448-9a19951d4c58 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73022025-02-13T05:22:12.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f7ad9419-bda5-4398-ba56-3bdfbd39b040 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73032025-02-13T05:22:12.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f7ad9419-bda5-4398-ba56-3bdfbd39b040 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73042025-02-13T05:22:12.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2504 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f7ad9419-bda5-4398-ba56-3bdfbd39b040 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73052025-02-13T05:22:13.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 321fb07c-a4ee-4778-9a75-a32204c6d1f5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73062025-02-13T05:22:13.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 321fb07c-a4ee-4778-9a75-a32204c6d1f5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73072025-02-13T05:22:13.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 321fb07c-a4ee-4778-9a75-a32204c6d1f5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73082025-02-13T05:22:14.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 767ef37a-f9fc-4ed0-b1cb-8fa372a19b3e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73092025-02-13T05:22:14.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 767ef37a-f9fc-4ed0-b1cb-8fa372a19b3e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73102025-02-13T05:22:14.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2533 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 767ef37a-f9fc-4ed0-b1cb-8fa372a19b3e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73112025-02-13T05:22:15.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e87214f6-ad40-42f8-bc79-b3592581fe09 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73122025-02-13T05:22:15.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e87214f6-ad40-42f8-bc79-b3592581fe09 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73132025-02-13T05:22:15.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = e87214f6-ad40-42f8-bc79-b3592581fe09 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73142025-02-13T05:22:16.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
73152025-02-13T05:22:16.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
73162025-02-13T05:22:16.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73172025-02-13T05:22:16.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73182025-02-13T05:22:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73192025-02-13T05:22:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73202025-02-13T05:22:16.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73212025-02-13T05:22:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73222025-02-13T05:22:16.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73232025-02-13T05:22:16.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.105787ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73242025-02-13T05:22:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73252025-02-13T05:22:16.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73262025-02-13T05:22:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73272025-02-13T05:22:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73282025-02-13T05:22:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73292025-02-13T05:22:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73302025-02-13T05:22:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
73312025-02-13T05:22:16.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73322025-02-13T05:22:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73332025-02-13T05:22:16.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
73342025-02-13T05:22:16.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.619727ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
73352025-02-13T05:22:16.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7aeab0d7-2de2-403e-9879-4d9b09b3e2e1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73362025-02-13T05:22:16.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7aeab0d7-2de2-403e-9879-4d9b09b3e2e1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73372025-02-13T05:22:16.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7aeab0d7-2de2-403e-9879-4d9b09b3e2e1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73382025-02-13T05:22:17.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 271b8ac5-024b-40fc-87c2-41b2bfc8d5ef roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73392025-02-13T05:22:17.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 271b8ac5-024b-40fc-87c2-41b2bfc8d5ef resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73402025-02-13T05:22:17.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 271b8ac5-024b-40fc-87c2-41b2bfc8d5ef response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73412025-02-13T05:22:18.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d90dc28a-368d-4402-a9d4-fdf588330130 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73422025-02-13T05:22:18.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d90dc28a-368d-4402-a9d4-fdf588330130 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73432025-02-13T05:22:18.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d90dc28a-368d-4402-a9d4-fdf588330130 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73442025-02-13T05:22:19.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ebd79c19-b2e8-4155-947f-b2fbb4375ba2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73452025-02-13T05:22:19.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ebd79c19-b2e8-4155-947f-b2fbb4375ba2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73462025-02-13T05:22:19.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ebd79c19-b2e8-4155-947f-b2fbb4375ba2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73472025-02-13T05:22:20.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 436 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = bb735559-a912-4273-ac71-de532aad99dd response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
73482025-02-13T05:22:20.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4f3df31a-e6f2-444e-ad0c-5f0c2b9c57a2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73492025-02-13T05:22:20.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4f3df31a-e6f2-444e-ad0c-5f0c2b9c57a2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73502025-02-13T05:22:20.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4f3df31a-e6f2-444e-ad0c-5f0c2b9c57a2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73512025-02-13T05:22:21.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1934df81-fca6-442b-86be-815acb17b339 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73522025-02-13T05:22:21.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1934df81-fca6-442b-86be-815acb17b339 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73532025-02-13T05:22:21.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1934df81-fca6-442b-86be-815acb17b339 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73542025-02-13T05:22:22.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a355f0b7-5224-4123-b057-b19972e1d2b1 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73552025-02-13T05:22:22.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a355f0b7-5224-4123-b057-b19972e1d2b1 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73562025-02-13T05:22:22.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2189 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a355f0b7-5224-4123-b057-b19972e1d2b1 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73572025-02-13T05:22:23.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1272f3ff-93c9-4db7-ac24-a11c804e662f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73582025-02-13T05:22:23.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1272f3ff-93c9-4db7-ac24-a11c804e662f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73592025-02-13T05:22:23.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2619 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1272f3ff-93c9-4db7-ac24-a11c804e662f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73602025-02-13T05:22:24.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 95100aa6-0516-493f-814c-7062dda53e5c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73612025-02-13T05:22:24.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 95100aa6-0516-493f-814c-7062dda53e5c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73622025-02-13T05:22:24.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2727 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 95100aa6-0516-493f-814c-7062dda53e5c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73632025-02-13T05:22:25.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 3aea07f6-4ebb-4670-83c1-e609fd9be97a roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
73642025-02-13T05:22:25.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 3aea07f6-4ebb-4670-83c1-e609fd9be97a resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
73652025-02-13T05:22:25.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2982 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 3aea07f6-4ebb-4670-83c1-e609fd9be97a response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
73662025-02-13T05:22:25.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 417149c1-2309-4df4-beb5-6952af0febe7 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
73672025-02-13T05:22:25.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 417149c1-2309-4df4-beb5-6952af0febe7 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
73682025-02-13T05:22:25.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2743 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 417149c1-2309-4df4-beb5-6952af0febe7 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
73692025-02-13T05:22:25.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = feec086a-1d67-4785-acd1-98180fe4556b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73702025-02-13T05:22:25.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = feec086a-1d67-4785-acd1-98180fe4556b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73712025-02-13T05:22:25.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1940 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = feec086a-1d67-4785-acd1-98180fe4556b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
73722025-02-13T05:22:26.237ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 29 reason = Timeout
73732025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
73742025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
73752025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
73762025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
73772025-02-13T05:22:26.238ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-13 05:12:26.238005422 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
73782025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
73792025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
73802025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
73812025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73822025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73832025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
73842025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73852025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
73862025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
73872025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73882025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
73892025-02-13T05:22:26.238ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73902025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
73912025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73922025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
73932025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
73942025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
73952025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73962025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
73972025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
73982025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73992025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
74002025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
74012025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74022025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
74032025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74042025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
74052025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
74062025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74072025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
74082025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
74092025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74102025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
74112025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
74122025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74132025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
74142025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Timeout
74152025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74162025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74172025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
74182025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
74192025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74202025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
74212025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74222025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
74232025-02-13T05:22:26.238ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
74242025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74252025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
74262025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74272025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
74282025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74292025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
74302025-02-13T05:22:26.238ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = e132683f-3ab0-4513-890f-86716ec9a9cf
74312025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.85\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf"}
74322025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
74332025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
74342025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
74352025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74362025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74372025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74382025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
74392025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
74402025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
74412025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74422025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74432025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74442025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74452025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74462025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74472025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74482025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74492025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
74502025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74512025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74522025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74532025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74542025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74552025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74562025-02-13T05:22:26.238ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ec95727a-7af6-45d1-9962-81bf544db84b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f580e8f1-7812-496c-8421-463d5f7ea1f8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 780734012 } })
74572025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74582025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74592025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74602025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74612025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74622025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74632025-02-13T05:22:26.238ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9f4eb8b3-c464-433c-b912-c7432c124258.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cc24f910-ffb5-4de8-b7e1-4b9d4d15a7cd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d80d65e7-849e-47a7-8d7e-e69f7cc544bb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 780783133 } })
74642025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74652025-02-13T05:22:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74662025-02-13T05:22:26.239ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
74672025-02-13T05:22:26.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.078331ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
74682025-02-13T05:22:26.239ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
74692025-02-13T05:22:26.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.009278ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
74702025-02-13T05:22:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.210671ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
74712025-02-13T05:22:26.241ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-13 05:12:26.238005422 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
74722025-02-13T05:22:26.241ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.571662ms iteration = 15 status = {"expiration":"2025-02-13T05:12:26.238005422Z","pruned":[]}
74732025-02-13T05:22:26.242ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.138288ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74742025-02-13T05:22:26.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 784568050 } })
74752025-02-13T05:22:26.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
74762025-02-13T05:22:26.245ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 7.056591ms iteration = 29 status = {"errors":[],"requests_created_ok":[]}
74772025-02-13T05:22:26.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 787227176 } })
74782025-02-13T05:22:26.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74792025-02-13T05:22:26.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
74802025-02-13T05:22:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74812025-02-13T05:22:26.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74822025-02-13T05:22:26.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.626234ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
74832025-02-13T05:22:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74842025-02-13T05:22:26.248ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
74852025-02-13T05:22:26.248ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
74862025-02-13T05:22:26.248ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.965784ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
74872025-02-13T05:22:26.248ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74882025-02-13T05:22:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
74892025-02-13T05:22:26.251ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74902025-02-13T05:22:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74912025-02-13T05:22:26.256ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74922025-02-13T05:22:26.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74932025-02-13T05:22:26.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74942025-02-13T05:22:26.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74952025-02-13T05:22:26.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74962025-02-13T05:22:26.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74972025-02-13T05:22:26.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.067668ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
74982025-02-13T05:22:26.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74992025-02-13T05:22:26.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75002025-02-13T05:22:26.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75012025-02-13T05:22:26.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75022025-02-13T05:22:26.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75032025-02-13T05:22:26.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75042025-02-13T05:22:26.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75052025-02-13T05:22:26.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75062025-02-13T05:22:26.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75072025-02-13T05:22:26.311ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75082025-02-13T05:22:26.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75092025-02-13T05:22:26.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75102025-02-13T05:22:26.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75112025-02-13T05:22:26.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75122025-02-13T05:22:26.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75132025-02-13T05:22:26.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75142025-02-13T05:22:26.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75152025-02-13T05:22:26.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75162025-02-13T05:22:26.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75172025-02-13T05:22:26.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75182025-02-13T05:22:26.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75192025-02-13T05:22:26.315ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75202025-02-13T05:22:26.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75212025-02-13T05:22:26.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75222025-02-13T05:22:26.316ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75232025-02-13T05:22:26.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75242025-02-13T05:22:26.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75252025-02-13T05:22:26.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75262025-02-13T05:22:26.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75272025-02-13T05:22:26.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75282025-02-13T05:22:26.318ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75292025-02-13T05:22:26.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75302025-02-13T05:22:26.319ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 860749008 } })
75312025-02-13T05:22:26.319ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
75322025-02-13T05:22:26.319ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75332025-02-13T05:22:26.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75342025-02-13T05:22:26.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75352025-02-13T05:22:26.320ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75362025-02-13T05:22:26.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75372025-02-13T05:22:26.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75382025-02-13T05:22:26.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
75392025-02-13T05:22:26.323ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75402025-02-13T05:22:26.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75412025-02-13T05:22:26.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
75422025-02-13T05:22:26.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75432025-02-13T05:22:26.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75442025-02-13T05:22:26.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75452025-02-13T05:22:26.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75462025-02-13T05:22:26.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75472025-02-13T05:22:26.328ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75482025-02-13T05:22:26.328ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75492025-02-13T05:22:26.328ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75502025-02-13T05:22:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75512025-02-13T05:22:26.329ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75522025-02-13T05:22:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75532025-02-13T05:22:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75542025-02-13T05:22:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
75552025-02-13T05:22:26.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75562025-02-13T05:22:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75572025-02-13T05:22:26.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75582025-02-13T05:22:26.334ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75592025-02-13T05:22:26.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75602025-02-13T05:22:26.336ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
75612025-02-13T05:22:26.336ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
75622025-02-13T05:22:26.336ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.944226ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
75632025-02-13T05:22:26.337ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.022297ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75642025-02-13T05:22:26.337ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
75652025-02-13T05:22:26.337ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
75662025-02-13T05:22:26.337ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
75672025-02-13T05:22:26.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75682025-02-13T05:22:26.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75692025-02-13T05:22:26.341ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75702025-02-13T05:22:26.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75712025-02-13T05:22:26.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
75722025-02-13T05:22:26.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75732025-02-13T05:22:26.346ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75742025-02-13T05:22:26.347ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75752025-02-13T05:22:26.347ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.063382ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75762025-02-13T05:22:26.347ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
75772025-02-13T05:22:26.347ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
75782025-02-13T05:22:26.347ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
75792025-02-13T05:22:26.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75802025-02-13T05:22:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75812025-02-13T05:22:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75822025-02-13T05:22:26.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75832025-02-13T05:22:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75842025-02-13T05:22:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75852025-02-13T05:22:26.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75862025-02-13T05:22:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75872025-02-13T05:22:26.358ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75882025-02-13T05:22:26.358ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.695974ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75892025-02-13T05:22:26.359ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
75902025-02-13T05:22:26.359ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 0 version = 2
75912025-02-13T05:22:26.359ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75922025-02-13T05:22:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75932025-02-13T05:22:26.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75942025-02-13T05:22:26.362ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75952025-02-13T05:22:26.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75962025-02-13T05:22:26.364ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
75972025-02-13T05:22:26.364ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 126.016194ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
75982025-02-13T05:22:26.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75992025-02-13T05:22:26.366ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
76002025-02-13T05:22:26.368ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76012025-02-13T05:22:26.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76022025-02-13T05:22:26.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76032025-02-13T05:22:26.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76042025-02-13T05:22:26.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76052025-02-13T05:22:26.372ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 162f9def-acb6-488a-9a2e-35fc5ef82284 dns_zone_name = oxide.test found_so_far = 1 version = 2
76062025-02-13T05:22:26.372ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
76072025-02-13T05:22:26.372ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-13 05:08:27.963644 UTC dns_group = external generation = 2
76082025-02-13T05:22:26.372ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 133.792536ms iteration = 15 status = {"generation":2}
76092025-02-13T05:22:26.380ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76102025-02-13T05:22:26.380ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 142.091222ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76112025-02-13T05:22:26.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76122025-02-13T05:22:26.383ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76132025-02-13T05:22:26.383ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76142025-02-13T05:22:26.383ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76152025-02-13T05:22:26.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76162025-02-13T05:22:26.389ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76172025-02-13T05:22:26.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76182025-02-13T05:22:26.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76192025-02-13T05:22:26.394ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76202025-02-13T05:22:26.394ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76212025-02-13T05:22:26.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76222025-02-13T05:22:26.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76232025-02-13T05:22:26.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76242025-02-13T05:22:26.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76252025-02-13T05:22:26.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76262025-02-13T05:22:26.412ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76272025-02-13T05:22:26.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76282025-02-13T05:22:26.413ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76292025-02-13T05:22:26.415ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76302025-02-13T05:22:26.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
76312025-02-13T05:22:26.417ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76322025-02-13T05:22:26.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76332025-02-13T05:22:26.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76342025-02-13T05:22:26.419ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76352025-02-13T05:22:26.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76362025-02-13T05:22:26.420ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 182.246824ms iteration = 29 status = 0
76372025-02-13T05:22:26.431ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76382025-02-13T05:22:26.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76392025-02-13T05:22:26.432ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
76402025-02-13T05:22:26.432ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76412025-02-13T05:22:26.432ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba027b74-8ed1-46d6-b00c-f9faec0b8803", "content-length": "26", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} })
76422025-02-13T05:22:26.433ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76432025-02-13T05:22:26.436ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76442025-02-13T05:22:26.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76452025-02-13T05:22:26.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76462025-02-13T05:22:26.442ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
76472025-02-13T05:22:26.442ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76482025-02-13T05:22:26.443ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c765201-f485-4eb8-b937-449622775b0d", "content-length": "26", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} })
76492025-02-13T05:22:26.443ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76502025-02-13T05:22:26.444ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
76512025-02-13T05:22:26.444ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
76522025-02-13T05:22:26.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76532025-02-13T05:22:26.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76542025-02-13T05:22:26.445ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76552025-02-13T05:22:26.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76562025-02-13T05:22:26.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76572025-02-13T05:22:26.448ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76582025-02-13T05:22:26.448ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76592025-02-13T05:22:26.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76602025-02-13T05:22:26.450ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76612025-02-13T05:22:26.450ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76622025-02-13T05:22:26.450ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 212.281578ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76632025-02-13T05:22:26.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76642025-02-13T05:22:26.452ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 214.002927ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
76652025-02-13T05:22:26.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76662025-02-13T05:22:26.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76672025-02-13T05:22:26.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76682025-02-13T05:22:26.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76692025-02-13T05:22:26.454ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76702025-02-13T05:22:26.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76712025-02-13T05:22:26.455ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b9b649f0-534f-4832-8b1c-c4f82eef7239 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
76722025-02-13T05:22:26.455ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
76732025-02-13T05:22:26.455ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-13 05:08:26.528706 UTC dns_group = internal generation = 1
76742025-02-13T05:22:26.455ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 217.496037ms iteration = 15 status = {"generation":1}
76752025-02-13T05:22:26.464ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-13T05:08:23.439194Z, time_modified: 2025-02-13T05:08:23.439194Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8f13615-12e0-4837-bffe-48620fa7aaa2, db_silo: Silo { identity: SiloIdentity { id: b8f13615-12e0-4837-bffe-48620fa7aaa2, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-13T05:08:27.903293Z, time_modified: 2025-02-13T05:08:27.903293Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d" }] }) }
76762025-02-13T05:22:26.464ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 226.219425ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]}},"default_endpoint":{"silo_id":"b8f13615-12e0-4837-bffe-48620fa7aaa2","tls_certs":["5a79d94a82f30ff01d364fb52e91be4ce97be94c0b988514e0ddd8fa0b52d75d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
76772025-02-13T05:22:26.484ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
76782025-02-13T05:22:26.484ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 245.942006ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
76792025-02-13T05:22:26.491ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
76802025-02-13T05:22:26.491ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76812025-02-13T05:22:26.492ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5049e77-3cc4-4d9c-a619-b118a29a6814", "content-length": "26", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} })
76822025-02-13T05:22:26.492ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76832025-02-13T05:22:26.495ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
76842025-02-13T05:22:26.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6448ba66-3590-4065-b607-8855e9102410 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
76852025-02-13T05:22:26.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6448ba66-3590-4065-b607-8855e9102410 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
76862025-02-13T05:22:26.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3904 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6448ba66-3590-4065-b607-8855e9102410 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
76872025-02-13T05:22:26.510ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
76882025-02-13T05:22:26.510ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ce6fd42b-8ed2-4c4f-8d6b-2e376fc213b7", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76892025-02-13T05:22:26.510ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76902025-02-13T05:22:26.513ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5615513f-01cd-4ca6-af40-e60c5691b04a", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76912025-02-13T05:22:26.513ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76922025-02-13T05:22:26.515ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76932025-02-13T05:22:26.515ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 277.422311ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
76942025-02-13T05:22:26.515ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
76952025-02-13T05:22:26.526ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 287.821747ms iteration = 31 status = {"physical_disks_added":0}
76962025-02-13T05:22:26.534ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
76972025-02-13T05:22:26.534ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 296.022711ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
76982025-02-13T05:22:26.590ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 352.794676ms iteration = 29 status = {}
76992025-02-13T05:22:26.601ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77002025-02-13T05:22:26.601ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77012025-02-13T05:22:26.602ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "55d2293b-6c37-49ee-9a06-1bd0607697d4", "content-length": "372", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} })
77022025-02-13T05:22:26.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77032025-02-13T05:22:26.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77042025-02-13T05:22:26.616ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
77052025-02-13T05:22:26.616ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77062025-02-13T05:22:26.616ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d09efaae-61c1-477e-9ca3-ee7b3e62a0b3", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} })
77072025-02-13T05:22:26.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77082025-02-13T05:22:26.616ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77092025-02-13T05:22:26.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77102025-02-13T05:22:26.617ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7296f315-29a0-40d4-95bf-443c8156e8da", "content-length": "2", "date": "Thu, 13 Feb 2025 05:22:25 GMT"} })
77112025-02-13T05:22:26.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77122025-02-13T05:22:26.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77132025-02-13T05:22:26.619ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77142025-02-13T05:22:26.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77152025-02-13T05:22:26.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77162025-02-13T05:22:26.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77172025-02-13T05:22:26.627ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
77182025-02-13T05:22:26.627ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4114e67f-4105-4166-9a07-5c1ed431800c", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77192025-02-13T05:22:26.627ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77202025-02-13T05:22:26.629ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4102c891-1531-46cb-bf90-33388cccdb1c", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77212025-02-13T05:22:26.629ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77222025-02-13T05:22:26.631ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8db26212-fd8c-46c0-8d18-cf0fbc1205a7", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77232025-02-13T05:22:26.631ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77242025-02-13T05:22:26.633ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77252025-02-13T05:22:26.633ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 395.542981ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
77262025-02-13T05:22:26.645ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77272025-02-13T05:22:26.645ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a86bf29-73c8-47b2-afbf-396ed5cda9be", "content-length": "691", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} })
77282025-02-13T05:22:26.645ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
77292025-02-13T05:22:26.645ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
77302025-02-13T05:22:26.645ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
77312025-02-13T05:22:26.646ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 408.599843ms iteration = 29 status = null
77322025-02-13T05:22:26.647ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 409.770997ms iteration = 30 status = {}
77332025-02-13T05:22:26.648ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77342025-02-13T05:22:26.648ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77352025-02-13T05:22:26.648ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "11126fda-a5d2-4142-bb64-a437dafa4bf5", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} })
77362025-02-13T05:22:26.651ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 413.146562ms iteration = 30 status = {}
77372025-02-13T05:22:26.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77382025-02-13T05:22:26.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77392025-02-13T05:22:26.697ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
77402025-02-13T05:22:26.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77412025-02-13T05:22:26.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77422025-02-13T05:22:26.707ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77432025-02-13T05:22:26.708ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dba9d7a-afdb-4126-bed0-db32683ec2ba", "content-length": "134", "date": "Thu, 13 Feb 2025 05:22:25 GMT"} })
77442025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77452025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
77462025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77472025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77482025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77492025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77502025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77512025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77522025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77532025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77542025-02-13T05:22:26.708ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
77552025-02-13T05:22:26.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77562025-02-13T05:22:26.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77572025-02-13T05:22:26.711ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77582025-02-13T05:22:26.711ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "39cf8bca-a243-4b6a-bf39-011f9d0033e6", "content-length": "2", "date": "Thu, 13 Feb 2025 05:22:25 GMT"} })
77592025-02-13T05:22:26.711ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
77602025-02-13T05:22:26.711ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb5d44be-9240-4384-bde1-3fa2fd64eed5", "content-length": "52", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} })
77612025-02-13T05:22:26.711ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
77622025-02-13T05:22:26.711ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
77632025-02-13T05:22:26.811ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3960b54e-f0fd-4dec-ac11-a8213690f8b5", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} })
77642025-02-13T05:22:26.811ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
77652025-02-13T05:22:26.811ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
77662025-02-13T05:22:26.811ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e6c3f02-db52-4a62-bfb4-8f0762e69137", "content-length": "682", "date": "Thu, 13 Feb 2025 05:22:26 GMT"} })
77672025-02-13T05:22:26.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77682025-02-13T05:22:26.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77692025-02-13T05:22:26.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77702025-02-13T05:22:26.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77712025-02-13T05:22:26.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77722025-02-13T05:22:26.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77732025-02-13T05:22:26.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77742025-02-13T05:22:26.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77752025-02-13T05:22:26.833ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 595.466588ms iteration = 29 status = {}
77762025-02-13T05:22:27.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2879faa8-8a83-4669-8586-7c3eeb498632 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77772025-02-13T05:22:27.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2879faa8-8a83-4669-8586-7c3eeb498632 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77782025-02-13T05:22:27.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2879faa8-8a83-4669-8586-7c3eeb498632 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77792025-02-13T05:22:28.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = be00ab7b-cb65-48a0-9b35-8353bdd74c92 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77802025-02-13T05:22:28.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = be00ab7b-cb65-48a0-9b35-8353bdd74c92 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77812025-02-13T05:22:28.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2598 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = be00ab7b-cb65-48a0-9b35-8353bdd74c92 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77822025-02-13T05:22:29.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fb2f3430-aa4a-4f51-af16-0d4ba28e79d2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77832025-02-13T05:22:29.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fb2f3430-aa4a-4f51-af16-0d4ba28e79d2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77842025-02-13T05:22:29.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = fb2f3430-aa4a-4f51-af16-0d4ba28e79d2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77852025-02-13T05:22:30.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 424 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 1e59928d-9c10-4cd0-af63-ed31b32556c7 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
77862025-02-13T05:22:30.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b6379636-5a76-4254-bf1e-03aad41e3371 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77872025-02-13T05:22:30.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b6379636-5a76-4254-bf1e-03aad41e3371 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77882025-02-13T05:22:30.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b6379636-5a76-4254-bf1e-03aad41e3371 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77892025-02-13T05:22:31.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 55c23746-2eb3-429c-822e-00ba2a53b7ef roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77902025-02-13T05:22:31.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 55c23746-2eb3-429c-822e-00ba2a53b7ef resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77912025-02-13T05:22:31.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 55c23746-2eb3-429c-822e-00ba2a53b7ef response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77922025-02-13T05:22:32.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9dc950b0-ea18-455e-a20f-6b89b9cf0750 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77932025-02-13T05:22:32.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9dc950b0-ea18-455e-a20f-6b89b9cf0750 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77942025-02-13T05:22:32.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9dc950b0-ea18-455e-a20f-6b89b9cf0750 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77952025-02-13T05:22:33.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d80d7e64-3383-4c7b-8d10-4a296e036efa roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77962025-02-13T05:22:33.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d80d7e64-3383-4c7b-8d10-4a296e036efa resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77972025-02-13T05:22:33.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d80d7e64-3383-4c7b-8d10-4a296e036efa response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77982025-02-13T05:22:34.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 73e48976-39b7-4a77-9131-d7101e3ed56e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
77992025-02-13T05:22:34.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 73e48976-39b7-4a77-9131-d7101e3ed56e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78002025-02-13T05:22:34.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 73e48976-39b7-4a77-9131-d7101e3ed56e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78012025-02-13T05:22:35.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f200ccac-3c4c-435f-9d91-6ac2522d5ebc roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78022025-02-13T05:22:35.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f200ccac-3c4c-435f-9d91-6ac2522d5ebc resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78032025-02-13T05:22:35.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f200ccac-3c4c-435f-9d91-6ac2522d5ebc response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78042025-02-13T05:22:36.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
78052025-02-13T05:22:36.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
78062025-02-13T05:22:36.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78072025-02-13T05:22:36.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78082025-02-13T05:22:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78092025-02-13T05:22:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78102025-02-13T05:22:36.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78112025-02-13T05:22:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78122025-02-13T05:22:36.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78132025-02-13T05:22:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78142025-02-13T05:22:36.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78152025-02-13T05:22:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78162025-02-13T05:22:36.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78172025-02-13T05:22:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
78182025-02-13T05:22:36.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78192025-02-13T05:22:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78202025-02-13T05:22:36.260ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
78212025-02-13T05:22:36.260ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.210251ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
78222025-02-13T05:22:36.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78232025-02-13T05:22:36.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78242025-02-13T05:22:36.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.006259ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78252025-02-13T05:22:36.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 753fd514-78e8-4df9-800c-1727c48fd72b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78262025-02-13T05:22:36.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 753fd514-78e8-4df9-800c-1727c48fd72b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78272025-02-13T05:22:36.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1869 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 753fd514-78e8-4df9-800c-1727c48fd72b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78282025-02-13T05:22:37.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 390481f2-a240-4efd-840b-3ad1a06c252d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78292025-02-13T05:22:37.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 390481f2-a240-4efd-840b-3ad1a06c252d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78302025-02-13T05:22:37.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 390481f2-a240-4efd-840b-3ad1a06c252d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78312025-02-13T05:22:38.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8881d851-1ba4-4733-b8b3-6710537cfef4 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78322025-02-13T05:22:38.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8881d851-1ba4-4733-b8b3-6710537cfef4 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78332025-02-13T05:22:38.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 8881d851-1ba4-4733-b8b3-6710537cfef4 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78342025-02-13T05:22:39.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3daa8f9e-9648-4a90-8399-6a1fe9e94044 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78352025-02-13T05:22:39.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3daa8f9e-9648-4a90-8399-6a1fe9e94044 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78362025-02-13T05:22:39.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3daa8f9e-9648-4a90-8399-6a1fe9e94044 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78372025-02-13T05:22:40.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 43140603-61a2-44fc-81db-ff6ff03a8554 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
78382025-02-13T05:22:40.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 43140603-61a2-44fc-81db-ff6ff03a8554 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
78392025-02-13T05:22:40.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3416 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 43140603-61a2-44fc-81db-ff6ff03a8554 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
78402025-02-13T05:22:40.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 3d97fa11-aacc-48a2-9faa-8cbc1e760d54 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
78412025-02-13T05:22:40.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 3d97fa11-aacc-48a2-9faa-8cbc1e760d54 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
78422025-02-13T05:22:40.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 3d97fa11-aacc-48a2-9faa-8cbc1e760d54 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
78432025-02-13T05:22:40.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 391 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 0332eb9b-06f6-4fca-bc53-0584121863f1 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
78442025-02-13T05:22:40.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 61cf3d28-d656-4c75-958f-ec9928733cb4 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78452025-02-13T05:22:40.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 61cf3d28-d656-4c75-958f-ec9928733cb4 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78462025-02-13T05:22:40.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 61cf3d28-d656-4c75-958f-ec9928733cb4 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78472025-02-13T05:22:41.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6e7417a8-a664-4fa7-8e89-a8c72938d166 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78482025-02-13T05:22:41.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6e7417a8-a664-4fa7-8e89-a8c72938d166 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78492025-02-13T05:22:41.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2771 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 6e7417a8-a664-4fa7-8e89-a8c72938d166 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78502025-02-13T05:22:42.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c5e24214-43e9-46c1-86d9-429a1b10e392 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78512025-02-13T05:22:42.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c5e24214-43e9-46c1-86d9-429a1b10e392 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78522025-02-13T05:22:42.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2765 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c5e24214-43e9-46c1-86d9-429a1b10e392 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78532025-02-13T05:22:43.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 93d3778c-7cce-4b5d-a950-cf20e4b658f9 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78542025-02-13T05:22:43.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 93d3778c-7cce-4b5d-a950-cf20e4b658f9 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78552025-02-13T05:22:43.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 93d3778c-7cce-4b5d-a950-cf20e4b658f9 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78562025-02-13T05:22:44.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ef1392ee-1f99-4511-b91d-d84b3b3e4456 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78572025-02-13T05:22:44.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ef1392ee-1f99-4511-b91d-d84b3b3e4456 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78582025-02-13T05:22:44.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ef1392ee-1f99-4511-b91d-d84b3b3e4456 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78592025-02-13T05:22:45.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = eeb0d635-5fda-411e-9b49-5e98c080423f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78602025-02-13T05:22:45.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = eeb0d635-5fda-411e-9b49-5e98c080423f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78612025-02-13T05:22:45.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = eeb0d635-5fda-411e-9b49-5e98c080423f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78622025-02-13T05:22:46.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
78632025-02-13T05:22:46.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
78642025-02-13T05:22:46.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78652025-02-13T05:22:46.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78662025-02-13T05:22:46.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78672025-02-13T05:22:46.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78682025-02-13T05:22:46.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78692025-02-13T05:22:46.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78702025-02-13T05:22:46.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78712025-02-13T05:22:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78722025-02-13T05:22:46.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78732025-02-13T05:22:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78742025-02-13T05:22:46.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.732064ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78752025-02-13T05:22:46.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78762025-02-13T05:22:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78772025-02-13T05:22:46.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78782025-02-13T05:22:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
78792025-02-13T05:22:46.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78802025-02-13T05:22:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78812025-02-13T05:22:46.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
78822025-02-13T05:22:46.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.884805ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
78832025-02-13T05:22:46.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3b9b35e2-83f0-4294-8ba9-afa6258c821b roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78842025-02-13T05:22:46.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3b9b35e2-83f0-4294-8ba9-afa6258c821b resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78852025-02-13T05:22:46.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 3b9b35e2-83f0-4294-8ba9-afa6258c821b response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78862025-02-13T05:22:47.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ba889126-14ae-4e84-a523-104931a8e5c5 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78872025-02-13T05:22:47.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ba889126-14ae-4e84-a523-104931a8e5c5 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78882025-02-13T05:22:47.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ba889126-14ae-4e84-a523-104931a8e5c5 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78892025-02-13T05:22:48.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d08f868f-b514-4a8e-bf77-d77b7e23f1b6 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78902025-02-13T05:22:48.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d08f868f-b514-4a8e-bf77-d77b7e23f1b6 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78912025-02-13T05:22:48.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d08f868f-b514-4a8e-bf77-d77b7e23f1b6 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78922025-02-13T05:22:50.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 67a8381f-3410-4f34-9aab-38f64cb45954 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78932025-02-13T05:22:50.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 67a8381f-3410-4f34-9aab-38f64cb45954 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78942025-02-13T05:22:50.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 67a8381f-3410-4f34-9aab-38f64cb45954 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78952025-02-13T05:22:50.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 770 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 326c0205-6b3b-4518-8345-41960f3dbe3e response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
78962025-02-13T05:22:51.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ed596924-d0c9-4798-9902-2cd82ff70212 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78972025-02-13T05:22:51.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ed596924-d0c9-4798-9902-2cd82ff70212 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78982025-02-13T05:22:51.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ed596924-d0c9-4798-9902-2cd82ff70212 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
78992025-02-13T05:22:52.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 926f7011-2281-4e61-9b26-950fe6331d00 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79002025-02-13T05:22:52.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 926f7011-2281-4e61-9b26-950fe6331d00 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79012025-02-13T05:22:52.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 926f7011-2281-4e61-9b26-950fe6331d00 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79022025-02-13T05:22:53.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d7b033af-8a7d-4005-aeb1-29e9aef7f891 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79032025-02-13T05:22:53.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d7b033af-8a7d-4005-aeb1-29e9aef7f891 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79042025-02-13T05:22:53.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = d7b033af-8a7d-4005-aeb1-29e9aef7f891 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79052025-02-13T05:22:54.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ee074ba8-2115-4e17-9b95-aa28b840b449 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79062025-02-13T05:22:54.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ee074ba8-2115-4e17-9b95-aa28b840b449 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79072025-02-13T05:22:54.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1897 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ee074ba8-2115-4e17-9b95-aa28b840b449 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79082025-02-13T05:22:55.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2e0c54ee-ddc9-4b03-beef-708d174eff2c roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79092025-02-13T05:22:55.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2e0c54ee-ddc9-4b03-beef-708d174eff2c resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79102025-02-13T05:22:55.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2768 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2e0c54ee-ddc9-4b03-beef-708d174eff2c response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79112025-02-13T05:22:55.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = dbf8d022-abca-4851-bee6-8ebc649cd039 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
79122025-02-13T05:22:55.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = dbf8d022-abca-4851-bee6-8ebc649cd039 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
79132025-02-13T05:22:55.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3323 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = dbf8d022-abca-4851-bee6-8ebc649cd039 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?sort_by=id_ascending
79142025-02-13T05:22:55.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 37b90be7-23df-4bcb-a1f5-0b0da81b8f43 roles = RoleSet { roles: {} } uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
79152025-02-13T05:22:55.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 37b90be7-23df-4bcb-a1f5-0b0da81b8f43 resource = Database result = Ok(()) uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
79162025-02-13T05:22:55.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2649 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38449 req_id = 37b90be7-23df-4bcb-a1f5-0b0da81b8f43 response_code = 200 uri = /metrics/collectors/93aa177d-6d80-4ea9-988c-9de41b46fd8d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNjgxN2MyOC1mNjIyLTQ4ZDgtOTQyNS02OWE4YjBjNGM1OWEifX0%3D
79172025-02-13T05:22:56.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 164f2009-a57d-41a7-9def-7eaba46a4f73 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79182025-02-13T05:22:56.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 164f2009-a57d-41a7-9def-7eaba46a4f73 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79192025-02-13T05:22:56.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 164f2009-a57d-41a7-9def-7eaba46a4f73 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
79202025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 30 reason = Timeout
79212025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
79222025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
79232025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
79242025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79252025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
79262025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79272025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79282025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
79292025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
79302025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79312025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79322025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
79332025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
79342025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79352025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
79362025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79372025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
79382025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79392025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
79402025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79412025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
79422025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
79432025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
79442025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
79452025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
79462025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79472025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79482025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
79492025-02-13T05:22:56.237ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
79502025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79512025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
79522025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 30 reason = Timeout
79532025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
79542025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79552025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79562025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
79572025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79582025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79592025-02-13T05:22:56.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79602025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79612025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79622025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79632025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79642025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79652025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
79662025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
79672025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79682025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79692025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79702025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79712025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
79722025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79732025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79742025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79752025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79762025-02-13T05:22:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79772025-02-13T05:22:56.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79782025-02-13T05:22:56.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79792025-02-13T05:22:56.241ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.764497ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
79802025-02-13T05:22:56.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1685, tv_nsec: 784474878 } })
79812025-02-13T05:22:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79822025-02-13T05:22:56.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79832025-02-13T05:22:56.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
79842025-02-13T05:22:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79852025-02-13T05:22:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79862025-02-13T05:22:56.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79872025-02-13T05:22:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79882025-02-13T05:22:56.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.438457ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
79892025-02-13T05:22:56.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79902025-02-13T05:22:56.248ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 11.357663ms iteration = 30 status = {"errors":[],"requests_created_ok":[]}
79912025-02-13T05:22:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79922025-02-13T05:22:56.250ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79932025-02-13T05:22:56.250ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79942025-02-13T05:22:56.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79952025-02-13T05:22:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79962025-02-13T05:22:56.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79972025-02-13T05:22:56.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79982025-02-13T05:22:56.253ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79992025-02-13T05:22:56.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80002025-02-13T05:22:56.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80012025-02-13T05:22:56.254ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1685, tv_nsec: 796772558 } })
80022025-02-13T05:22:56.255ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
80032025-02-13T05:22:56.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80042025-02-13T05:22:56.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80052025-02-13T05:22:56.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80062025-02-13T05:22:56.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80072025-02-13T05:22:56.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80082025-02-13T05:22:56.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80092025-02-13T05:22:56.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80102025-02-13T05:22:56.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80112025-02-13T05:22:56.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
80122025-02-13T05:22:56.258ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80132025-02-13T05:22:56.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80142025-02-13T05:22:56.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80152025-02-13T05:22:56.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80162025-02-13T05:22:56.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80172025-02-13T05:22:56.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80182025-02-13T05:22:56.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80192025-02-13T05:22:56.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80202025-02-13T05:22:56.264ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80212025-02-13T05:22:56.264ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 25.813884ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80222025-02-13T05:22:56.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80232025-02-13T05:22:56.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80242025-02-13T05:22:56.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80252025-02-13T05:22:56.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80262025-02-13T05:22:56.266ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5835b48f-f45d-4fa8-91ed-38d933d73732.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1685, tv_nsec: 808277225 } })
80272025-02-13T05:22:56.266ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
80282025-02-13T05:22:56.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80292025-02-13T05:22:56.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80302025-02-13T05:22:56.272ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80312025-02-13T05:22:56.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80322025-02-13T05:22:56.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80332025-02-13T05:22:56.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80342025-02-13T05:22:56.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
80352025-02-13T05:22:56.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80362025-02-13T05:22:56.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80372025-02-13T05:22:56.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80382025-02-13T05:22:56.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80392025-02-13T05:22:56.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80402025-02-13T05:22:56.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
80412025-02-13T05:22:56.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.130163ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
80422025-02-13T05:22:56.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80432025-02-13T05:22:56.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80442025-02-13T05:22:56.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80452025-02-13T05:22:56.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80462025-02-13T05:22:56.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80472025-02-13T05:22:56.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80482025-02-13T05:22:56.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80492025-02-13T05:22:56.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80502025-02-13T05:22:56.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80512025-02-13T05:22:56.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80522025-02-13T05:22:56.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.210422ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
80532025-02-13T05:22:56.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80542025-02-13T05:22:56.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.050801ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80552025-02-13T05:22:56.315ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80562025-02-13T05:22:56.315ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80572025-02-13T05:22:56.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80582025-02-13T05:22:56.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80592025-02-13T05:22:56.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5835b48f-f45d-4fa8-91ed-38d933d73732, lookup_type: ById(5835b48f-f45d-4fa8-91ed-38d933d73732) } result = Ok(())
80602025-02-13T05:22:56.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80612025-02-13T05:22:56.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80622025-02-13T05:22:56.317ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
80632025-02-13T05:22:56.317ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80642025-02-13T05:22:56.317ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb4faa5b-f700-42de-8dd4-34175715c893", "content-length": "26", "date": "Thu, 13 Feb 2025 05:22:56 GMT"} })
80652025-02-13T05:22:56.317ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80662025-02-13T05:22:56.317ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80672025-02-13T05:22:56.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80682025-02-13T05:22:56.318ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.427368ms iteration = 30 status = 0
80692025-02-13T05:22:56.319ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80702025-02-13T05:22:56.319ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80712025-02-13T05:22:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
80722025-02-13T05:22:56.323ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80732025-02-13T05:22:56.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80742025-02-13T05:22:56.325ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
80752025-02-13T05:22:56.325ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 87.338394ms iteration = 30 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
80762025-02-13T05:22:56.333ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.212728ms iteration = 32 status = {"physical_disks_added":0}
80772025-02-13T05:22:56.339ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
80782025-02-13T05:22:56.339ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80792025-02-13T05:22:56.339ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fca340f-6fc7-4a61-9bd9-18cab0082210", "content-length": "26", "date": "Thu, 13 Feb 2025 05:22:56 GMT"} })
80802025-02-13T05:22:56.339ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80812025-02-13T05:22:56.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80822025-02-13T05:22:56.341ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 103.603477ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80832025-02-13T05:22:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80842025-02-13T05:22:56.346ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 109.038581ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80852025-02-13T05:22:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80862025-02-13T05:22:56.349ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.45764ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
80872025-02-13T05:22:56.363ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80882025-02-13T05:22:56.364ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80892025-02-13T05:22:56.364ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.249132ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80902025-02-13T05:22:56.366ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80912025-02-13T05:22:56.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80922025-02-13T05:22:56.370ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d zone_address = fd00:1122:3344:101::2
80932025-02-13T05:22:56.370ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80942025-02-13T05:22:56.370ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1abf14de-782e-4312-8690-62e031ebda4c", "content-length": "26", "date": "Thu, 13 Feb 2025 05:22:56 GMT"} })
80952025-02-13T05:22:56.370ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80962025-02-13T05:22:56.372ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
80972025-02-13T05:22:56.422ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 184.750516ms iteration = 30 status = {}
80982025-02-13T05:22:56.513ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80992025-02-13T05:22:56.514ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "51767956-4508-4baf-a68b-3032855fb603", "content-length": "2", "date": "Thu, 13 Feb 2025 05:22:55 GMT"} })
81002025-02-13T05:22:56.515ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81012025-02-13T05:22:56.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81022025-02-13T05:22:56.535ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81032025-02-13T05:22:56.535ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81042025-02-13T05:22:56.535ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ea5bcc-d236-498e-b387-c7827db1d92d", "content-length": "372", "date": "Thu, 13 Feb 2025 05:22:56 GMT"} })
81052025-02-13T05:22:56.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81062025-02-13T05:22:56.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81072025-02-13T05:22:56.538ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 300.389315ms iteration = 30 status = null
81082025-02-13T05:22:56.552ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81092025-02-13T05:22:56.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81102025-02-13T05:22:56.581ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
81112025-02-13T05:22:56.581ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81122025-02-13T05:22:56.581ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f0544db5-979c-4986-b1ac-50f11f262359", "date": "Thu, 13 Feb 2025 05:22:56 GMT"} })
81132025-02-13T05:22:56.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81142025-02-13T05:22:56.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81152025-02-13T05:22:56.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81162025-02-13T05:22:56.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81172025-02-13T05:22:56.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81182025-02-13T05:22:56.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81192025-02-13T05:22:56.595ZINFOnexus (BackgroundTasks): VPC route manager sled 5835b48f-f45d-4fa8-91ed-38d933d73732 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81202025-02-13T05:22:56.595ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81212025-02-13T05:22:56.596ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9b2c5cb6-eec0-4e4e-86fa-7c38e92d1ca9", "date": "Thu, 13 Feb 2025 05:22:56 GMT"} })
81222025-02-13T05:22:56.597ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 360.112103ms iteration = 31 status = {}
81232025-02-13T05:22:56.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81242025-02-13T05:22:56.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81252025-02-13T05:22:56.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81262025-02-13T05:22:56.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81272025-02-13T05:22:56.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81282025-02-13T05:22:56.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81292025-02-13T05:22:56.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81302025-02-13T05:22:56.610ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6d8f03c2-2c79-4a52-b9bd-f2c5139a438a, rack_id: c3272b8c-876d-43d9-a1f4-8963a7553b1d, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b7a5639b-ff72-4b69-accf-7d660e234535) } rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
81312025-02-13T05:22:56.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81322025-02-13T05:22:56.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81332025-02-13T05:22:56.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81342025-02-13T05:22:56.611ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81352025-02-13T05:22:56.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81362025-02-13T05:22:56.619ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81372025-02-13T05:22:56.619ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "91e8db83-1e9b-439c-801c-509ad0f293c1", "content-length": "134", "date": "Thu, 13 Feb 2025 05:22:55 GMT"} })
81382025-02-13T05:22:56.619ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81392025-02-13T05:22:56.619ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b7a5639b-ff72-4b69-accf-7d660e234535
81402025-02-13T05:22:56.619ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81412025-02-13T05:22:56.619ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81422025-02-13T05:22:56.619ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81432025-02-13T05:22:56.619ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81442025-02-13T05:22:56.619ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81452025-02-13T05:22:56.619ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81462025-02-13T05:22:56.620ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81472025-02-13T05:22:56.620ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81482025-02-13T05:22:56.620ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d
81492025-02-13T05:22:56.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81502025-02-13T05:22:56.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81512025-02-13T05:22:56.623ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81522025-02-13T05:22:56.623ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "61a5dc50-6872-4f4d-93a9-08469258ef5d", "content-length": "2", "date": "Thu, 13 Feb 2025 05:22:55 GMT"} })
81532025-02-13T05:22:56.623ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81542025-02-13T05:22:56.623ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "68a18068-c298-49c9-9814-1f599d692f23", "content-length": "52", "date": "Thu, 13 Feb 2025 05:22:55 GMT"} })
81552025-02-13T05:22:56.623ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch_location = Switch0
81562025-02-13T05:22:56.623ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81572025-02-13T05:22:56.645ZDEBGnexus (BackgroundTasks): client request SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81582025-02-13T05:22:56.728ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cc76580b-bc73-4dc0-b6b6-3cfaca013674", "date": "Thu, 13 Feb 2025 05:22:56 GMT"} })
81592025-02-13T05:22:56.728ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d switch = Switch0
81602025-02-13T05:22:56.728ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81612025-02-13T05:22:56.729ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c3272b8c-876d-43d9-a1f4-8963a7553b1d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d219e35a-81bf-4a0c-9c52-2e4a024fa794", "content-length": "682", "date": "Thu, 13 Feb 2025 05:22:56 GMT"} })
81622025-02-13T05:22:56.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81632025-02-13T05:22:56.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81642025-02-13T05:22:56.730ZDEBGnexus (BackgroundTasks): client response SledAgent = 5835b48f-f45d-4fa8-91ed-38d933d73732 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "575f4c2b-f74e-4560-9e5e-9e1bca42e53b", "content-length": "691", "date": "Thu, 13 Feb 2025 05:22:56 GMT"} })
81652025-02-13T05:22:56.730ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
81662025-02-13T05:22:56.730ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
81672025-02-13T05:22:56.730ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
81682025-02-13T05:22:56.731ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.956481ms iteration = 31 status = {}
81692025-02-13T05:22:56.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81702025-02-13T05:22:56.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81712025-02-13T05:22:56.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81722025-02-13T05:22:56.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81732025-02-13T05:22:56.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81742025-02-13T05:22:56.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81752025-02-13T05:22:56.747ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 510.254584ms iteration = 30 status = {}
81762025-02-13T05:22:57.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 18eadd05-521b-4361-8cf3-b53819c15696 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81772025-02-13T05:22:57.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 18eadd05-521b-4361-8cf3-b53819c15696 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81782025-02-13T05:22:57.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 18eadd05-521b-4361-8cf3-b53819c15696 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81792025-02-13T05:22:58.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4e3091b1-77ed-4d16-964e-ce767e96f5d2 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81802025-02-13T05:22:58.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4e3091b1-77ed-4d16-964e-ce767e96f5d2 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81812025-02-13T05:22:58.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 4e3091b1-77ed-4d16-964e-ce767e96f5d2 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81822025-02-13T05:22:59.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = af4ef724-08e6-4805-8ef9-29bd964c41bd roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81832025-02-13T05:22:59.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = af4ef724-08e6-4805-8ef9-29bd964c41bd resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81842025-02-13T05:22:59.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = af4ef724-08e6-4805-8ef9-29bd964c41bd response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81852025-02-13T05:23:00.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 834 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 30de12cd-73e7-4c84-917e-fad039794e48 response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
81862025-02-13T05:23:00.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b50245ff-22bf-46fc-a446-ceff931fff17 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81872025-02-13T05:23:00.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b50245ff-22bf-46fc-a446-ceff931fff17 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81882025-02-13T05:23:00.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = b50245ff-22bf-46fc-a446-ceff931fff17 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81892025-02-13T05:23:01.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7a8c2439-548b-43d0-804c-97742e381dbf roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81902025-02-13T05:23:01.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7a8c2439-548b-43d0-804c-97742e381dbf resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81912025-02-13T05:23:01.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 7a8c2439-548b-43d0-804c-97742e381dbf response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81922025-02-13T05:23:02.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 674066cd-c1b9-4db5-9170-675c63f67148 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81932025-02-13T05:23:02.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 674066cd-c1b9-4db5-9170-675c63f67148 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81942025-02-13T05:23:02.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 674066cd-c1b9-4db5-9170-675c63f67148 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81952025-02-13T05:23:03.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 12517ec7-d22e-4174-9a93-b15547621ae4 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81962025-02-13T05:23:03.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 12517ec7-d22e-4174-9a93-b15547621ae4 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81972025-02-13T05:23:03.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 12517ec7-d22e-4174-9a93-b15547621ae4 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81982025-02-13T05:23:04.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2bf78a4c-b605-417c-8f44-432f5cbd2e0a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
81992025-02-13T05:23:04.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2bf78a4c-b605-417c-8f44-432f5cbd2e0a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82002025-02-13T05:23:04.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2550 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 2bf78a4c-b605-417c-8f44-432f5cbd2e0a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82012025-02-13T05:23:05.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9a515c7d-049c-4056-ab47-18294e824cd8 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82022025-02-13T05:23:05.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9a515c7d-049c-4056-ab47-18294e824cd8 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82032025-02-13T05:23:05.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9a515c7d-049c-4056-ab47-18294e824cd8 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82042025-02-13T05:23:06.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
82052025-02-13T05:23:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
82062025-02-13T05:23:06.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82072025-02-13T05:23:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82082025-02-13T05:23:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82092025-02-13T05:23:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82102025-02-13T05:23:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82112025-02-13T05:23:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82122025-02-13T05:23:06.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82132025-02-13T05:23:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82142025-02-13T05:23:06.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82152025-02-13T05:23:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82162025-02-13T05:23:06.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82172025-02-13T05:23:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82182025-02-13T05:23:06.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82192025-02-13T05:23:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
82202025-02-13T05:23:06.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82212025-02-13T05:23:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82222025-02-13T05:23:06.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
82232025-02-13T05:23:06.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.925016ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
82242025-02-13T05:23:06.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.908903ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82252025-02-13T05:23:06.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 10ed8c99-2db9-481e-bbc7-fcecfdfc5f50 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82262025-02-13T05:23:06.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 10ed8c99-2db9-481e-bbc7-fcecfdfc5f50 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82272025-02-13T05:23:06.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 10ed8c99-2db9-481e-bbc7-fcecfdfc5f50 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82282025-02-13T05:23:07.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 10ce54e3-cbe5-4859-98fb-aad2411cc91f roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82292025-02-13T05:23:07.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 10ce54e3-cbe5-4859-98fb-aad2411cc91f resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82302025-02-13T05:23:07.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2492 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 10ce54e3-cbe5-4859-98fb-aad2411cc91f response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82312025-02-13T05:23:08.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ba2f173d-c976-4a8a-b700-ebc2768cac89 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82322025-02-13T05:23:08.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ba2f173d-c976-4a8a-b700-ebc2768cac89 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82332025-02-13T05:23:08.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ba2f173d-c976-4a8a-b700-ebc2768cac89 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82342025-02-13T05:23:09.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ec520d78-87e9-4661-8426-0174ae3028d8 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82352025-02-13T05:23:09.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ec520d78-87e9-4661-8426-0174ae3028d8 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82362025-02-13T05:23:09.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2984 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ec520d78-87e9-4661-8426-0174ae3028d8 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82372025-02-13T05:23:10.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 507 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = cc6f1179-dab2-476a-913c-901fc19e6b1e response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
82382025-02-13T05:23:10.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 58288e09-1998-434f-9df6-37bcb92acc90 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82392025-02-13T05:23:10.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 58288e09-1998-434f-9df6-37bcb92acc90 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82402025-02-13T05:23:10.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2600 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 58288e09-1998-434f-9df6-37bcb92acc90 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82412025-02-13T05:23:11.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f559f7e2-7412-4f43-a6de-3eded90b0745 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82422025-02-13T05:23:11.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f559f7e2-7412-4f43-a6de-3eded90b0745 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82432025-02-13T05:23:11.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = f559f7e2-7412-4f43-a6de-3eded90b0745 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82442025-02-13T05:23:12.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c7f576bc-b4de-419d-9209-e2114c95466d roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82452025-02-13T05:23:12.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c7f576bc-b4de-419d-9209-e2114c95466d resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82462025-02-13T05:23:12.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2723 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = c7f576bc-b4de-419d-9209-e2114c95466d response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82472025-02-13T05:23:13.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9afa1c7a-2a90-4eb7-9796-afc1f1957a9e roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82482025-02-13T05:23:13.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9afa1c7a-2a90-4eb7-9796-afc1f1957a9e resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82492025-02-13T05:23:13.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 9afa1c7a-2a90-4eb7-9796-afc1f1957a9e response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82502025-02-13T05:23:14.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ab2ed3f1-126d-45fc-bb7b-d02b310a1299 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82512025-02-13T05:23:14.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ab2ed3f1-126d-45fc-bb7b-d02b310a1299 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82522025-02-13T05:23:14.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = ab2ed3f1-126d-45fc-bb7b-d02b310a1299 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82532025-02-13T05:23:15.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a9332a03-3c3b-4b5b-8e26-a930107604ff roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82542025-02-13T05:23:15.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a9332a03-3c3b-4b5b-8e26-a930107604ff resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82552025-02-13T05:23:15.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1959 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a9332a03-3c3b-4b5b-8e26-a930107604ff response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82562025-02-13T05:23:16.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
82572025-02-13T05:23:16.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
82582025-02-13T05:23:16.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82592025-02-13T05:23:16.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82602025-02-13T05:23:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82612025-02-13T05:23:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82622025-02-13T05:23:16.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82632025-02-13T05:23:16.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82642025-02-13T05:23:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82652025-02-13T05:23:16.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.062206ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82662025-02-13T05:23:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82672025-02-13T05:23:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82682025-02-13T05:23:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82692025-02-13T05:23:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82702025-02-13T05:23:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82712025-02-13T05:23:16.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82722025-02-13T05:23:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: e132683f-3ab0-4513-890f-86716ec9a9cf, lookup_type: ById(e132683f-3ab0-4513-890f-86716ec9a9cf) } result = Ok(())
82732025-02-13T05:23:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82742025-02-13T05:23:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82752025-02-13T05:23:16.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = e132683f-3ab0-4513-890f-86716ec9a9cf original_time_created = 2025-02-13 05:08:15.490750 UTC target_id = e132683f-3ab0-4513-890f-86716ec9a9cf time_created = 2025-02-13 05:08:15.490750 UTC
82762025-02-13T05:23:16.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.866233ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"e132683f-3ab0-4513-890f-86716ec9a9cf","time_created":"2025-02-13T05:08:15.490750Z"}
82772025-02-13T05:23:16.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 226ce286-698b-475f-8f6c-eda7056cdf84 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82782025-02-13T05:23:16.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 226ce286-698b-475f-8f6c-eda7056cdf84 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82792025-02-13T05:23:16.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2239 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 226ce286-698b-475f-8f6c-eda7056cdf84 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82802025-02-13T05:23:17.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 63704e4d-78e8-41a4-9f32-b8946852e30a roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82812025-02-13T05:23:17.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 63704e4d-78e8-41a4-9f32-b8946852e30a resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82822025-02-13T05:23:17.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 63704e4d-78e8-41a4-9f32-b8946852e30a response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82832025-02-13T05:23:18.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 528e0795-f336-4425-b503-80a20ea571de roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82842025-02-13T05:23:18.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 528e0795-f336-4425-b503-80a20ea571de resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82852025-02-13T05:23:18.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 528e0795-f336-4425-b503-80a20ea571de response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82862025-02-13T05:23:19.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 046c5a2c-2879-4c0f-8cd9-2bfb339e4089 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82872025-02-13T05:23:19.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 046c5a2c-2879-4c0f-8cd9-2bfb339e4089 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82882025-02-13T05:23:19.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 046c5a2c-2879-4c0f-8cd9-2bfb339e4089 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82892025-02-13T05:23:20.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 427 local_addr = [fd00:1122:3344:101::a]:49586 method = GET remote_addr = [fd00:1122:3344:101::d]:61404 req_id = 9ece83a2-b5b1-4360-b079-afecc53059fc response_code = 200 uri = /a8269f60-9104-4275-9edc-a31614d5c23e
82902025-02-13T05:23:20.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0a01281c-6700-496c-816b-62b323baceaa roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82912025-02-13T05:23:20.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0a01281c-6700-496c-816b-62b323baceaa resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82922025-02-13T05:23:20.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 0a01281c-6700-496c-816b-62b323baceaa response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82932025-02-13T05:23:21.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a3796053-f575-4d4b-bb09-8b410c952eef roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82942025-02-13T05:23:21.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a3796053-f575-4d4b-bb09-8b410c952eef resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82952025-02-13T05:23:21.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2823 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = a3796053-f575-4d4b-bb09-8b410c952eef response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82962025-02-13T05:23:22.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1fbe6efc-dadd-4925-b1c5-74d911e38ff3 roles = RoleSet { roles: {} } uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82972025-02-13T05:23:22.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1fbe6efc-dadd-4925-b1c5-74d911e38ff3 resource = Database result = Ok(()) uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732
82982025-02-13T05:23:22.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2491 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58353 req_id = 1fbe6efc-dadd-4925-b1c5-74d911e38ff3 response_code = 200 uri = /probes/5835b48f-f45d-4fa8-91ed-38d933d73732