Max level shown:
12025-02-21T10:00:02.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bd21c1cb-9279-4c84-8cf5-b925de9571be roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
22025-02-21T10:00:02.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bd21c1cb-9279-4c84-8cf5-b925de9571be resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
32025-02-21T10:00:02.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3107 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bd21c1cb-9279-4c84-8cf5-b925de9571be response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
42025-02-21T10:00:03.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c8e74d6d-37dc-4158-a714-4f782e766bab roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
52025-02-21T10:00:03.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c8e74d6d-37dc-4158-a714-4f782e766bab resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
62025-02-21T10:00:03.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3284 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c8e74d6d-37dc-4158-a714-4f782e766bab response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
72025-02-21T10:00:03.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
82025-02-21T10:00:03.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
92025-02-21T10:00:03.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102025-02-21T10:00:03.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112025-02-21T10:00:03.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122025-02-21T10:00:03.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132025-02-21T10:00:03.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142025-02-21T10:00:03.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
152025-02-21T10:00:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
162025-02-21T10:00:03.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
172025-02-21T10:00:03.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
182025-02-21T10:00:03.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192025-02-21T10:00:03.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
202025-02-21T10:00:03.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
212025-02-21T10:00:03.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.66319ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
222025-02-21T10:00:03.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
232025-02-21T10:00:03.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
242025-02-21T10:00:03.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
252025-02-21T10:00:03.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
262025-02-21T10:00:03.633ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
272025-02-21T10:00:03.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.728779ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
282025-02-21T10:00:04.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4f78a1e0-7d04-4c92-bd2c-5187f01531d0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
292025-02-21T10:00:04.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4f78a1e0-7d04-4c92-bd2c-5187f01531d0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
302025-02-21T10:00:04.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2687 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4f78a1e0-7d04-4c92-bd2c-5187f01531d0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
312025-02-21T10:00:05.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb7b5d95-689c-414b-aef1-f22b65281f07 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
322025-02-21T10:00:05.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb7b5d95-689c-414b-aef1-f22b65281f07 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
332025-02-21T10:00:05.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3356 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb7b5d95-689c-414b-aef1-f22b65281f07 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
342025-02-21T10:00:06.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8ee0fc7c-1583-480e-8b7f-7a0a65be2c6a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
352025-02-21T10:00:06.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8ee0fc7c-1583-480e-8b7f-7a0a65be2c6a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
362025-02-21T10:00:06.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2684 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8ee0fc7c-1583-480e-8b7f-7a0a65be2c6a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
372025-02-21T10:00:06.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 602 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 1a21f47b-b20b-4482-89c4-04fd81cee872 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
382025-02-21T10:00:07.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a740ae41-def1-45d8-9663-0b7237a94764 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
392025-02-21T10:00:07.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a740ae41-def1-45d8-9663-0b7237a94764 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
402025-02-21T10:00:07.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2781 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a740ae41-def1-45d8-9663-0b7237a94764 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
412025-02-21T10:00:08.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5b92ebc8-6dd2-4f0f-bb7a-f33857e76d05 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
422025-02-21T10:00:08.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5b92ebc8-6dd2-4f0f-bb7a-f33857e76d05 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
432025-02-21T10:00:08.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5b92ebc8-6dd2-4f0f-bb7a-f33857e76d05 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
442025-02-21T10:00:09.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 951c9f2a-74d9-4320-a9b9-ade96207be62 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
452025-02-21T10:00:09.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 951c9f2a-74d9-4320-a9b9-ade96207be62 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
462025-02-21T10:00:09.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2902 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 951c9f2a-74d9-4320-a9b9-ade96207be62 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
472025-02-21T10:00:10.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1b3050e4-e272-4b92-9879-00066da54186 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
482025-02-21T10:00:10.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1b3050e4-e272-4b92-9879-00066da54186 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
492025-02-21T10:00:10.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3354 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1b3050e4-e272-4b92-9879-00066da54186 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
502025-02-21T10:00:11.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 658d5be6-6fc2-48e0-b010-04620fe1f8c0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
512025-02-21T10:00:11.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 658d5be6-6fc2-48e0-b010-04620fe1f8c0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
522025-02-21T10:00:11.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2633 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 658d5be6-6fc2-48e0-b010-04620fe1f8c0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
532025-02-21T10:00:12.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = be7bce86-4d20-487e-8c3a-0af7ba4184a7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
542025-02-21T10:00:12.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = be7bce86-4d20-487e-8c3a-0af7ba4184a7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
552025-02-21T10:00:12.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2783 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = be7bce86-4d20-487e-8c3a-0af7ba4184a7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
562025-02-21T10:00:13.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0796dd97-287a-4344-92d6-63e95880276d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
572025-02-21T10:00:13.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0796dd97-287a-4344-92d6-63e95880276d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
582025-02-21T10:00:13.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0796dd97-287a-4344-92d6-63e95880276d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
592025-02-21T10:00:13.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
602025-02-21T10:00:13.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
612025-02-21T10:00:13.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
622025-02-21T10:00:13.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
632025-02-21T10:00:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
642025-02-21T10:00:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
652025-02-21T10:00:13.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
662025-02-21T10:00:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
672025-02-21T10:00:13.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
682025-02-21T10:00:13.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.41404ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
692025-02-21T10:00:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
702025-02-21T10:00:13.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
712025-02-21T10:00:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
722025-02-21T10:00:13.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
732025-02-21T10:00:13.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
742025-02-21T10:00:13.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
752025-02-21T10:00:13.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
762025-02-21T10:00:13.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
772025-02-21T10:00:13.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
782025-02-21T10:00:13.727ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
792025-02-21T10:00:13.727ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 166.975731ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
802025-02-21T10:00:14.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5f882e93-1517-4299-bea2-6fbb7ad45d56 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
812025-02-21T10:00:14.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5f882e93-1517-4299-bea2-6fbb7ad45d56 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
822025-02-21T10:00:14.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3158 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5f882e93-1517-4299-bea2-6fbb7ad45d56 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
832025-02-21T10:00:15.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e9cbcdb0-4607-4ab7-9684-5398ed4910a9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
842025-02-21T10:00:15.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e9cbcdb0-4607-4ab7-9684-5398ed4910a9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
852025-02-21T10:00:15.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2966 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e9cbcdb0-4607-4ab7-9684-5398ed4910a9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
862025-02-21T10:00:16.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c4fce595-f0aa-43a4-b000-e96ce57c1df3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
872025-02-21T10:00:16.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c4fce595-f0aa-43a4-b000-e96ce57c1df3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
882025-02-21T10:00:16.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2630 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c4fce595-f0aa-43a4-b000-e96ce57c1df3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
892025-02-21T10:00:16.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 710 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 571ba44d-1cb8-4348-a877-766b1188b257 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
902025-02-21T10:00:17.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = faad9dae-888e-47de-84b5-60689b4b4cf4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
912025-02-21T10:00:17.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = faad9dae-888e-47de-84b5-60689b4b4cf4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
922025-02-21T10:00:17.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = faad9dae-888e-47de-84b5-60689b4b4cf4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
932025-02-21T10:00:18.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4cabfc2e-7afc-41eb-8273-61577fde84d8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
942025-02-21T10:00:18.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4cabfc2e-7afc-41eb-8273-61577fde84d8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
952025-02-21T10:00:18.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2810 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4cabfc2e-7afc-41eb-8273-61577fde84d8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
962025-02-21T10:00:19.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fccb612b-ef8a-4596-928f-155056c84633 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
972025-02-21T10:00:19.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fccb612b-ef8a-4596-928f-155056c84633 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
982025-02-21T10:00:19.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2543 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fccb612b-ef8a-4596-928f-155056c84633 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
992025-02-21T10:00:20.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dcf4acf3-73f6-496b-9979-c2fe57bc0c6c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
1002025-02-21T10:00:20.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dcf4acf3-73f6-496b-9979-c2fe57bc0c6c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
1012025-02-21T10:00:20.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dcf4acf3-73f6-496b-9979-c2fe57bc0c6c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
1022025-02-21T10:00:21.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ad3748ac-5883-412d-90bd-dccf9eb4a592 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
1032025-02-21T10:00:21.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ad3748ac-5883-412d-90bd-dccf9eb4a592 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
1042025-02-21T10:00:21.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2667 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ad3748ac-5883-412d-90bd-dccf9eb4a592 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
1052025-02-21T10:00:22.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55602013-106b-4d15-9335-9f5776af4583 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
1062025-02-21T10:00:22.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55602013-106b-4d15-9335-9f5776af4583 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
1072025-02-21T10:00:22.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55602013-106b-4d15-9335-9f5776af4583 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
1082025-02-21T10:00:22.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 86652989-8585-41a9-9cf1-489dba4824fb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
1092025-02-21T10:00:22.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 86652989-8585-41a9-9cf1-489dba4824fb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
1102025-02-21T10:00:22.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4392 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 86652989-8585-41a9-9cf1-489dba4824fb response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
1112025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
1122025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1132025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
1142025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1152025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 5 reason = Timeout
1162025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
1172025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
1182025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
1192025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
1202025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1212025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
1222025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
1232025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1242025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1252025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
1262025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1272025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
1282025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1292025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
1302025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
1312025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1322025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
1332025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1342025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 5 reason = Timeout
1352025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1362025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
1372025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
1382025-02-21T10:00:23.559ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-21 09:50:23.559906278 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1392025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
1402025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1412025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1422025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1432025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
1442025-02-21T10:00:23.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1452025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1462025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
1472025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1482025-02-21T10:00:23.560ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1492025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
1502025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1512025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1522025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
1532025-02-21T10:00:23.560ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041
1542025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.77\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041"}
1552025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
1562025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1572025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
1582025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1592025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1602025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
1612025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1622025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
1632025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
1642025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
1652025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1662025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1672025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
1682025-02-21T10:00:23.560ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1692025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1702025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
1712025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
1722025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1732025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
1742025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
1752025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1762025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1772025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1782025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
1792025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1802025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1812025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1822025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1832025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1842025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1852025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1862025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1872025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1882025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1892025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1902025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1912025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1922025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1932025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1942025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1952025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1962025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1972025-02-21T10:00:23.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3bf841e1-42b9-4bd7-ac20-7644b8a83464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1221, tv_nsec: 856685519 } })
1982025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1992025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2002025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2012025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2022025-02-21T10:00:23.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d154e9e-6d90-4040-b311-004f0e299e85.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e63432d-4205-48df-bd2b-03a054e87ab0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1221, tv_nsec: 856779381 } })
2032025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2042025-02-21T10:00:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2052025-02-21T10:00:23.561ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
2062025-02-21T10:00:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.147658ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
2072025-02-21T10:00:23.561ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
2082025-02-21T10:00:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.525607ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
2092025-02-21T10:00:23.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2102025-02-21T10:00:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2112025-02-21T10:00:23.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.750275ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
2122025-02-21T10:00:23.565ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1221, tv_nsec: 861191268 } })
2132025-02-21T10:00:23.565ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
2142025-02-21T10:00:23.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2152025-02-21T10:00:23.567ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-21 09:50:23.559906278 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2162025-02-21T10:00:23.567ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.843549ms iteration = 3 status = {"expiration":"2025-02-21T09:50:23.559906278Z","pruned":[]}
2172025-02-21T10:00:23.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2182025-02-21T10:00:23.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2192025-02-21T10:00:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2202025-02-21T10:00:23.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2212025-02-21T10:00:23.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2222025-02-21T10:00:23.574ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.858128ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
2232025-02-21T10:00:23.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1221, tv_nsec: 893801005 } })
2242025-02-21T10:00:23.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
2252025-02-21T10:00:23.608ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 49.098865ms iteration = 5 status = {"errors":[],"requests_created_ok":[]}
2262025-02-21T10:00:23.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2272025-02-21T10:00:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2282025-02-21T10:00:23.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2292025-02-21T10:00:23.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2302025-02-21T10:00:23.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2312025-02-21T10:00:23.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322025-02-21T10:00:23.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2332025-02-21T10:00:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2342025-02-21T10:00:23.614ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2352025-02-21T10:00:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2362025-02-21T10:00:23.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2372025-02-21T10:00:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2382025-02-21T10:00:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2392025-02-21T10:00:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2402025-02-21T10:00:23.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.18451ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
2412025-02-21T10:00:23.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2422025-02-21T10:00:23.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.410539ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2432025-02-21T10:00:23.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2442025-02-21T10:00:23.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2452025-02-21T10:00:23.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2462025-02-21T10:00:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2472025-02-21T10:00:23.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2482025-02-21T10:00:23.621ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2492025-02-21T10:00:23.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2502025-02-21T10:00:23.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2512025-02-21T10:00:23.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2522025-02-21T10:00:23.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2532025-02-21T10:00:23.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2542025-02-21T10:00:23.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2552025-02-21T10:00:23.623ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2562025-02-21T10:00:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2572025-02-21T10:00:23.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2582025-02-21T10:00:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2592025-02-21T10:00:23.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2602025-02-21T10:00:23.625ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2612025-02-21T10:00:23.625ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2622025-02-21T10:00:23.625ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.334477ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2632025-02-21T10:00:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2642025-02-21T10:00:23.625ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2652025-02-21T10:00:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2662025-02-21T10:00:23.625ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2672025-02-21T10:00:23.625ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2682025-02-21T10:00:23.625ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2692025-02-21T10:00:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2702025-02-21T10:00:23.626ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2712025-02-21T10:00:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2722025-02-21T10:00:23.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2732025-02-21T10:00:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2742025-02-21T10:00:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2752025-02-21T10:00:23.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2762025-02-21T10:00:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2772025-02-21T10:00:23.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2782025-02-21T10:00:23.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2792025-02-21T10:00:23.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2802025-02-21T10:00:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2812025-02-21T10:00:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
2822025-02-21T10:00:23.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2832025-02-21T10:00:23.633ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1221, tv_nsec: 929947087 } })
2842025-02-21T10:00:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2852025-02-21T10:00:23.634ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
2862025-02-21T10:00:23.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2872025-02-21T10:00:23.634ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2882025-02-21T10:00:23.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2892025-02-21T10:00:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2902025-02-21T10:00:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2912025-02-21T10:00:23.636ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2922025-02-21T10:00:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2932025-02-21T10:00:23.638ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2942025-02-21T10:00:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2952025-02-21T10:00:23.641ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2962025-02-21T10:00:23.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.226291ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2972025-02-21T10:00:23.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2982025-02-21T10:00:23.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2992025-02-21T10:00:23.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3002025-02-21T10:00:23.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3012025-02-21T10:00:23.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.329888ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3022025-02-21T10:00:23.649ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
3032025-02-21T10:00:23.649ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.889866ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
3042025-02-21T10:00:23.649ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3052025-02-21T10:00:23.649ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3062025-02-21T10:00:23.649ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3072025-02-21T10:00:23.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3082025-02-21T10:00:23.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3092025-02-21T10:00:23.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3102025-02-21T10:00:23.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3112025-02-21T10:00:23.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3122025-02-21T10:00:23.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3132025-02-21T10:00:23.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3142025-02-21T10:00:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3152025-02-21T10:00:23.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3162025-02-21T10:00:23.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3172025-02-21T10:00:23.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.54935ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
3182025-02-21T10:00:23.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3192025-02-21T10:00:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3202025-02-21T10:00:23.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3212025-02-21T10:00:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3222025-02-21T10:00:23.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3232025-02-21T10:00:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3242025-02-21T10:00:23.664ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3252025-02-21T10:00:23.664ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3262025-02-21T10:00:23.664ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3272025-02-21T10:00:23.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3282025-02-21T10:00:23.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3292025-02-21T10:00:23.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3302025-02-21T10:00:23.667ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3312025-02-21T10:00:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3322025-02-21T10:00:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3332025-02-21T10:00:23.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3342025-02-21T10:00:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3352025-02-21T10:00:23.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3362025-02-21T10:00:23.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3372025-02-21T10:00:23.674ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 114.180776ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
3382025-02-21T10:00:23.675ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3392025-02-21T10:00:23.675ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3402025-02-21T10:00:23.675ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3412025-02-21T10:00:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3422025-02-21T10:00:23.677ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3432025-02-21T10:00:23.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 126.460093ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3442025-02-21T10:00:23.687ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3452025-02-21T10:00:23.687ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3462025-02-21T10:00:23.687ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 127.551139ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3472025-02-21T10:00:23.691ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3482025-02-21T10:00:23.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5810deb9-e6cc-4de6-8cbb-09caa981bb0f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
3492025-02-21T10:00:23.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5810deb9-e6cc-4de6-8cbb-09caa981bb0f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
3502025-02-21T10:00:23.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3542 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5810deb9-e6cc-4de6-8cbb-09caa981bb0f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
3512025-02-21T10:00:23.704ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3522025-02-21T10:00:23.704ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3532025-02-21T10:00:23.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3542025-02-21T10:00:23.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3552025-02-21T10:00:23.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3562025-02-21T10:00:23.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3572025-02-21T10:00:23.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3582025-02-21T10:00:23.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3592025-02-21T10:00:23.709ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3602025-02-21T10:00:23.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3612025-02-21T10:00:23.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3622025-02-21T10:00:23.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
3632025-02-21T10:00:23.712ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3642025-02-21T10:00:23.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3652025-02-21T10:00:23.714ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3662025-02-21T10:00:23.714ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 0 version = 2
3672025-02-21T10:00:23.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3682025-02-21T10:00:23.714ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3692025-02-21T10:00:23.714ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3702025-02-21T10:00:23.714ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-21 09:58:29.164998 UTC dns_group = internal generation = 1
3712025-02-21T10:00:23.714ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 154.787757ms iteration = 3 status = {"generation":1}
3722025-02-21T10:00:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3732025-02-21T10:00:23.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3742025-02-21T10:00:23.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3752025-02-21T10:00:23.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3762025-02-21T10:00:23.717ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3772025-02-21T10:00:23.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3782025-02-21T10:00:23.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3792025-02-21T10:00:23.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3802025-02-21T10:00:23.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3812025-02-21T10:00:23.720ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3822025-02-21T10:00:23.720ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3832025-02-21T10:00:23.720ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 160.393862ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3842025-02-21T10:00:23.721ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 1 version = 2
3852025-02-21T10:00:23.721ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3862025-02-21T10:00:23.721ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-21 09:58:29.727106 UTC dns_group = external generation = 2
3872025-02-21T10:00:23.721ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 161.437627ms iteration = 3 status = {"generation":2}
3882025-02-21T10:00:23.739ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
3892025-02-21T10:00:23.739ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 179.384051ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
3902025-02-21T10:00:23.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
3912025-02-21T10:00:23.739ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3922025-02-21T10:00:23.740ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "afb4c1fb-d4d0-4e68-b4d5-c1385896a257", "content-length": "26", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
3932025-02-21T10:00:23.740ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3942025-02-21T10:00:23.742ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3952025-02-21T10:00:23.745ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
3962025-02-21T10:00:23.745ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 185.58185ms iteration = 5 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
3972025-02-21T10:00:23.762ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-21T09:58:18.895783Z, time_modified: 2025-02-21T09:58:18.895783Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }) }
3982025-02-21T10:00:23.763ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
3992025-02-21T10:00:23.763ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4002025-02-21T10:00:23.763ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a7c8912-ee83-4492-8b91-1ae30ef7a095", "content-length": "26", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
4012025-02-21T10:00:23.763ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4022025-02-21T10:00:23.764ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 204.608159ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]}},"default_endpoint":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4032025-02-21T10:00:23.765ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4042025-02-21T10:00:23.781ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 221.61892ms iteration = 7 status = {"physical_disks_added":0}
4052025-02-21T10:00:23.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4062025-02-21T10:00:23.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4072025-02-21T10:00:23.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4082025-02-21T10:00:23.840ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
4092025-02-21T10:00:23.840ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4102025-02-21T10:00:23.841ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6241571c-9956-461d-83c1-35aa74277e1d", "content-length": "26", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
4112025-02-21T10:00:23.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4122025-02-21T10:00:23.843ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
4132025-02-21T10:00:23.857ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4142025-02-21T10:00:23.858ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "95379311-3777-4cc1-992f-d5bc6475c90a", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4152025-02-21T10:00:23.858ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4162025-02-21T10:00:23.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4172025-02-21T10:00:23.859ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8496651f-21ef-4359-9a8c-a9fd9121c33a", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4182025-02-21T10:00:23.859ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4192025-02-21T10:00:23.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4202025-02-21T10:00:23.860ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4212025-02-21T10:00:23.860ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 300.770841ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4222025-02-21T10:00:23.867ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4232025-02-21T10:00:23.868ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4242025-02-21T10:00:23.868ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee330bfc-a4da-4b82-8e87-009a4705d2a8", "content-length": "372", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
4252025-02-21T10:00:23.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4262025-02-21T10:00:23.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4272025-02-21T10:00:23.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4282025-02-21T10:00:23.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4292025-02-21T10:00:23.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4302025-02-21T10:00:23.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4312025-02-21T10:00:23.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4322025-02-21T10:00:23.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4332025-02-21T10:00:23.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4342025-02-21T10:00:23.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4352025-02-21T10:00:23.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
4362025-02-21T10:00:23.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4372025-02-21T10:00:23.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4382025-02-21T10:00:23.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4392025-02-21T10:00:23.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4402025-02-21T10:00:23.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4412025-02-21T10:00:23.879ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 319.201576ms iteration = 5 status = 0
4422025-02-21T10:00:23.881ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4432025-02-21T10:00:23.882ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2997b0f-3e4d-4f3f-8601-9b85da53249d", "content-length": "1", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
4442025-02-21T10:00:23.883ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4452025-02-21T10:00:23.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4462025-02-21T10:00:23.885ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 325.921088ms iteration = 5 status = null
4472025-02-21T10:00:23.894ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 334.633898ms iteration = 5 status = {}
4482025-02-21T10:00:23.932ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4492025-02-21T10:00:23.933ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7698acd5-376d-4a83-92a8-b7723e466762", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4502025-02-21T10:00:23.933ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4512025-02-21T10:00:23.934ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bc92dd9a-6068-4615-a6f9-89570f6806d7", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4522025-02-21T10:00:23.934ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4532025-02-21T10:00:23.935ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c466cd88-267e-4c50-b60e-eacbad6abb23", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4542025-02-21T10:00:23.935ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4552025-02-21T10:00:23.937ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4562025-02-21T10:00:23.937ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 377.613896ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4572025-02-21T10:00:23.948ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4582025-02-21T10:00:23.948ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "63e926d1-81c5-4d4e-8369-aff037f1bd29", "content-length": "691", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
4592025-02-21T10:00:23.948ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
4602025-02-21T10:00:23.948ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4612025-02-21T10:00:23.948ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
4622025-02-21T10:00:23.950ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 390.074296ms iteration = 5 status = {}
4632025-02-21T10:00:23.989ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
4642025-02-21T10:00:23.989ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4652025-02-21T10:00:23.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c8d82c37-58f9-42de-a9d8-5827991208f1", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
4662025-02-21T10:00:23.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4672025-02-21T10:00:23.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4682025-02-21T10:00:23.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4692025-02-21T10:00:23.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4702025-02-21T10:00:24.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4712025-02-21T10:00:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4722025-02-21T10:00:24.006ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
4732025-02-21T10:00:24.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4742025-02-21T10:00:24.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4752025-02-21T10:00:24.018ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4762025-02-21T10:00:24.018ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ac56d1f-7c46-4986-8a27-c074ccb9c85e", "content-length": "134", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
4772025-02-21T10:00:24.018ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4782025-02-21T10:00:24.018ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
4792025-02-21T10:00:24.019ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4802025-02-21T10:00:24.019ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4812025-02-21T10:00:24.019ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4822025-02-21T10:00:24.019ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4832025-02-21T10:00:24.019ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4842025-02-21T10:00:24.019ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4852025-02-21T10:00:24.019ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4862025-02-21T10:00:24.019ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4872025-02-21T10:00:24.019ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
4882025-02-21T10:00:24.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4892025-02-21T10:00:24.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4902025-02-21T10:00:24.021ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4912025-02-21T10:00:24.021ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9aa9f14-6d7b-4847-9ba5-129587f79956", "content-length": "2", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
4922025-02-21T10:00:24.021ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4932025-02-21T10:00:24.022ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "07137bb0-2ede-47e9-ac35-772e123e0f99", "content-length": "52", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
4942025-02-21T10:00:24.022ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
4952025-02-21T10:00:24.022ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4962025-02-21T10:00:24.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4972025-02-21T10:00:24.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4982025-02-21T10:00:24.095ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4992025-02-21T10:00:24.095ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5002025-02-21T10:00:24.123ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ab580daf-2dc9-4399-8517-cfd057ffaaf2", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
5012025-02-21T10:00:24.123ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
5022025-02-21T10:00:24.123ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5032025-02-21T10:00:24.124ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cb3f17ee-28e7-4cd5-bc54-a07b048f32d5", "date": "Fri, 21 Feb 2025 10:00:23 GMT"} })
5042025-02-21T10:00:24.125ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 565.329177ms iteration = 5 status = {}
5052025-02-21T10:00:24.125ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7cfd008-ef8b-4b50-8679-7d6b20c631f2", "content-length": "682", "date": "Fri, 21 Feb 2025 10:00:24 GMT"} })
5062025-02-21T10:00:24.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5072025-02-21T10:00:24.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5082025-02-21T10:00:24.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5092025-02-21T10:00:24.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5102025-02-21T10:00:24.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5112025-02-21T10:00:24.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5122025-02-21T10:00:24.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5132025-02-21T10:00:24.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5142025-02-21T10:00:24.475ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 915.884341ms iteration = 5 status = {}
5152025-02-21T10:00:24.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f5c1d575-6e41-4679-a69b-be28f97f1ce7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5162025-02-21T10:00:24.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f5c1d575-6e41-4679-a69b-be28f97f1ce7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5172025-02-21T10:00:24.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1597 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f5c1d575-6e41-4679-a69b-be28f97f1ce7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5182025-02-21T10:00:25.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 113f9dad-2c37-45b6-8cec-2ead392e5cd4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5192025-02-21T10:00:25.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 113f9dad-2c37-45b6-8cec-2ead392e5cd4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5202025-02-21T10:00:25.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2829 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 113f9dad-2c37-45b6-8cec-2ead392e5cd4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5212025-02-21T10:00:26.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 546 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 969a161e-d8b9-4dfa-ab00-c91445d89b1e response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
5222025-02-21T10:00:26.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b0a0e36a-55f4-43c6-8026-3b5a3a50c45e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5232025-02-21T10:00:26.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b0a0e36a-55f4-43c6-8026-3b5a3a50c45e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5242025-02-21T10:00:26.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2685 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b0a0e36a-55f4-43c6-8026-3b5a3a50c45e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5252025-02-21T10:00:27.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cd108e0f-9b1b-48ed-83ef-f2fa21b36fe5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5262025-02-21T10:00:27.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cd108e0f-9b1b-48ed-83ef-f2fa21b36fe5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5272025-02-21T10:00:27.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2564 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cd108e0f-9b1b-48ed-83ef-f2fa21b36fe5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5282025-02-21T10:00:28.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b28c9a31-9a68-47ca-a194-78fe69e6277e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5292025-02-21T10:00:28.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b28c9a31-9a68-47ca-a194-78fe69e6277e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5302025-02-21T10:00:28.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3031 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b28c9a31-9a68-47ca-a194-78fe69e6277e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5312025-02-21T10:00:29.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = aa1e99ad-dd8a-4b63-a75a-bc2a1f69b9bb roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5322025-02-21T10:00:29.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = aa1e99ad-dd8a-4b63-a75a-bc2a1f69b9bb resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5332025-02-21T10:00:29.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = aa1e99ad-dd8a-4b63-a75a-bc2a1f69b9bb response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5342025-02-21T10:00:30.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d1c235b-d7a7-4b71-81b9-6c41df2b2d6b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5352025-02-21T10:00:30.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d1c235b-d7a7-4b71-81b9-6c41df2b2d6b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5362025-02-21T10:00:30.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2485 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d1c235b-d7a7-4b71-81b9-6c41df2b2d6b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5372025-02-21T10:00:31.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5b31c25f-dad6-4cf7-9df6-ae13c353fdb8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5382025-02-21T10:00:31.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5b31c25f-dad6-4cf7-9df6-ae13c353fdb8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5392025-02-21T10:00:31.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2822 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5b31c25f-dad6-4cf7-9df6-ae13c353fdb8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5402025-02-21T10:00:32.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 660ba1b3-476f-4910-9b04-c5b5aa1e09ed roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5412025-02-21T10:00:32.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 660ba1b3-476f-4910-9b04-c5b5aa1e09ed resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5422025-02-21T10:00:32.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 660ba1b3-476f-4910-9b04-c5b5aa1e09ed response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5432025-02-21T10:00:33.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
5442025-02-21T10:00:33.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5452025-02-21T10:00:33.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
5462025-02-21T10:00:33.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5472025-02-21T10:00:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5482025-02-21T10:00:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5492025-02-21T10:00:33.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5502025-02-21T10:00:33.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5512025-02-21T10:00:33.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5522025-02-21T10:00:33.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.54438ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5532025-02-21T10:00:33.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5542025-02-21T10:00:33.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5552025-02-21T10:00:33.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5562025-02-21T10:00:33.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5572025-02-21T10:00:33.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5582025-02-21T10:00:33.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5592025-02-21T10:00:33.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
5602025-02-21T10:00:33.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5612025-02-21T10:00:33.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5622025-02-21T10:00:33.616ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
5632025-02-21T10:00:33.616ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.708578ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
5642025-02-21T10:00:33.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 727153ab-3c9e-44fe-bcc8-92ee2efaf0ec roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5652025-02-21T10:00:33.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 727153ab-3c9e-44fe-bcc8-92ee2efaf0ec resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5662025-02-21T10:00:33.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 727153ab-3c9e-44fe-bcc8-92ee2efaf0ec response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5672025-02-21T10:00:34.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49d32059-4cd5-4c66-8a9a-6a3b3f2e7baf roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5682025-02-21T10:00:34.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49d32059-4cd5-4c66-8a9a-6a3b3f2e7baf resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5692025-02-21T10:00:34.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2727 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49d32059-4cd5-4c66-8a9a-6a3b3f2e7baf response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5702025-02-21T10:00:35.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7d3c9c3-ec5a-404e-92d2-f82f79d169ee roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5712025-02-21T10:00:35.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7d3c9c3-ec5a-404e-92d2-f82f79d169ee resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5722025-02-21T10:00:35.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2967 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7d3c9c3-ec5a-404e-92d2-f82f79d169ee response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5732025-02-21T10:00:36.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 541 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 1ad7527c-6b12-45a1-8d61-31d4c7df511b response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
5742025-02-21T10:00:36.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7bb9850-20a5-4fed-b211-879b7d9ef0fa roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5752025-02-21T10:00:36.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7bb9850-20a5-4fed-b211-879b7d9ef0fa resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5762025-02-21T10:00:36.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3014 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7bb9850-20a5-4fed-b211-879b7d9ef0fa response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5772025-02-21T10:00:38.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 83b92f5f-799d-48ec-9b84-c7dd11410a24 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5782025-02-21T10:00:38.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 83b92f5f-799d-48ec-9b84-c7dd11410a24 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5792025-02-21T10:00:38.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2834 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 83b92f5f-799d-48ec-9b84-c7dd11410a24 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5802025-02-21T10:00:39.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 632259d5-b66d-41d2-841f-6045e4968b61 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5812025-02-21T10:00:39.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 632259d5-b66d-41d2-841f-6045e4968b61 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5822025-02-21T10:00:39.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 632259d5-b66d-41d2-841f-6045e4968b61 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5832025-02-21T10:00:40.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d6fec354-54e4-4b2c-8b8e-473cc5c3816f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5842025-02-21T10:00:40.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d6fec354-54e4-4b2c-8b8e-473cc5c3816f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5852025-02-21T10:00:40.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2775 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d6fec354-54e4-4b2c-8b8e-473cc5c3816f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5862025-02-21T10:00:41.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 41e7d68d-29a0-40d7-aa00-38a7cf436971 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5872025-02-21T10:00:41.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 41e7d68d-29a0-40d7-aa00-38a7cf436971 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5882025-02-21T10:00:41.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2925 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 41e7d68d-29a0-40d7-aa00-38a7cf436971 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5892025-02-21T10:00:42.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f9881f9c-78c7-4452-be79-dafe9520f933 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5902025-02-21T10:00:42.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f9881f9c-78c7-4452-be79-dafe9520f933 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5912025-02-21T10:00:42.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f9881f9c-78c7-4452-be79-dafe9520f933 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5922025-02-21T10:00:43.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dfb51630-c002-4a10-9ef5-78c64119aa6a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5932025-02-21T10:00:43.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dfb51630-c002-4a10-9ef5-78c64119aa6a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5942025-02-21T10:00:43.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3138 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dfb51630-c002-4a10-9ef5-78c64119aa6a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
5952025-02-21T10:00:43.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
5962025-02-21T10:00:43.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5972025-02-21T10:00:43.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
5982025-02-21T10:00:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5992025-02-21T10:00:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6002025-02-21T10:00:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6012025-02-21T10:00:43.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6022025-02-21T10:00:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6032025-02-21T10:00:43.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6042025-02-21T10:00:43.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.004607ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6052025-02-21T10:00:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6062025-02-21T10:00:43.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6072025-02-21T10:00:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6082025-02-21T10:00:43.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6092025-02-21T10:00:43.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6102025-02-21T10:00:43.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6112025-02-21T10:00:43.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
6122025-02-21T10:00:43.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6132025-02-21T10:00:43.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6142025-02-21T10:00:43.579ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
6152025-02-21T10:00:43.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.308779ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
6162025-02-21T10:00:44.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7f4f19f5-6cc4-468d-b579-bfe1d4beea89 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6172025-02-21T10:00:44.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7f4f19f5-6cc4-468d-b579-bfe1d4beea89 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6182025-02-21T10:00:44.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7f4f19f5-6cc4-468d-b579-bfe1d4beea89 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6192025-02-21T10:00:45.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30b4dd89-fa71-4d2c-86c8-50df6bce3730 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6202025-02-21T10:00:45.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30b4dd89-fa71-4d2c-86c8-50df6bce3730 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6212025-02-21T10:00:45.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2667 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30b4dd89-fa71-4d2c-86c8-50df6bce3730 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6222025-02-21T10:00:46.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1f49f738-2de0-4ed6-ab52-df40cbbe3cc9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6232025-02-21T10:00:46.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1f49f738-2de0-4ed6-ab52-df40cbbe3cc9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6242025-02-21T10:00:46.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2856 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1f49f738-2de0-4ed6-ab52-df40cbbe3cc9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6252025-02-21T10:00:46.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 669 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 124b6751-5312-40e0-b661-8a90dc7f2b44 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
6262025-02-21T10:00:47.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2a8876cc-cf2e-4235-85e8-25a5f3f767a5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6272025-02-21T10:00:47.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2a8876cc-cf2e-4235-85e8-25a5f3f767a5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6282025-02-21T10:00:47.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2808 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2a8876cc-cf2e-4235-85e8-25a5f3f767a5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6292025-02-21T10:00:48.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5ff37540-0d4c-4b4b-bf90-cc0e3f458ff8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6302025-02-21T10:00:48.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5ff37540-0d4c-4b4b-bf90-cc0e3f458ff8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6312025-02-21T10:00:48.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5ff37540-0d4c-4b4b-bf90-cc0e3f458ff8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6322025-02-21T10:00:49.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 855d9ae2-fc8d-4ad3-97b8-98530c29fbc8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6332025-02-21T10:00:49.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 855d9ae2-fc8d-4ad3-97b8-98530c29fbc8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6342025-02-21T10:00:49.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2734 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 855d9ae2-fc8d-4ad3-97b8-98530c29fbc8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6352025-02-21T10:00:50.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 188360ce-119b-4ddb-a389-13baa08fcbd0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6362025-02-21T10:00:50.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 188360ce-119b-4ddb-a389-13baa08fcbd0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6372025-02-21T10:00:50.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2618 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 188360ce-119b-4ddb-a389-13baa08fcbd0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6382025-02-21T10:00:51.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0dfe9822-50f3-4fab-b9b2-9da239170a39 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6392025-02-21T10:00:51.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0dfe9822-50f3-4fab-b9b2-9da239170a39 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6402025-02-21T10:00:51.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0dfe9822-50f3-4fab-b9b2-9da239170a39 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6412025-02-21T10:00:52.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 92dc0572-2443-4ba2-9678-933e2f2404a6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6422025-02-21T10:00:52.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 92dc0572-2443-4ba2-9678-933e2f2404a6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6432025-02-21T10:00:52.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2676 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 92dc0572-2443-4ba2-9678-933e2f2404a6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6442025-02-21T10:00:52.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = da4ef075-0437-4e48-a8a3-191680835845 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
6452025-02-21T10:00:52.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = da4ef075-0437-4e48-a8a3-191680835845 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
6462025-02-21T10:00:52.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 105354 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = da4ef075-0437-4e48-a8a3-191680835845 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
6472025-02-21T10:00:53.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff3e77c2-72a6-414a-9867-d31636748113 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6482025-02-21T10:00:53.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff3e77c2-72a6-414a-9867-d31636748113 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6492025-02-21T10:00:53.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2586 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff3e77c2-72a6-414a-9867-d31636748113 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
6502025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
6512025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6522025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
6532025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
6542025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6552025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
6562025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 6 reason = Timeout
6572025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
6582025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6592025-02-21T10:00:53.560ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6602025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6612025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6622025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
6632025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6642025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
6652025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6662025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
6672025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6682025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6692025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
6702025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6712025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
6722025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
6732025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6742025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6752025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
6762025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6772025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
6782025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6792025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
6802025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6812025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 6 reason = Timeout
6822025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
6832025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
6842025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6852025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
6862025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6872025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
6882025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6892025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6902025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6912025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6922025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6932025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6942025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6952025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6962025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6972025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6982025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6992025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7002025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7012025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7022025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
7032025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7042025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7052025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7062025-02-21T10:00:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7072025-02-21T10:00:53.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7082025-02-21T10:00:53.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7092025-02-21T10:00:53.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7102025-02-21T10:00:53.563ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.547126ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7112025-02-21T10:00:53.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7122025-02-21T10:00:53.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7132025-02-21T10:00:53.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7142025-02-21T10:00:53.564ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152025-02-21T10:00:53.565ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7162025-02-21T10:00:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7172025-02-21T10:00:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7182025-02-21T10:00:53.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7192025-02-21T10:00:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7202025-02-21T10:00:53.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7212025-02-21T10:00:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7222025-02-21T10:00:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7232025-02-21T10:00:53.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7242025-02-21T10:00:53.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7252025-02-21T10:00:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7262025-02-21T10:00:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7272025-02-21T10:00:53.567ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7282025-02-21T10:00:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7292025-02-21T10:00:53.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7302025-02-21T10:00:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7312025-02-21T10:00:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7322025-02-21T10:00:53.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7332025-02-21T10:00:53.570ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1251, tv_nsec: 866252580 } })
7342025-02-21T10:00:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7352025-02-21T10:00:53.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7362025-02-21T10:00:53.570ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
7372025-02-21T10:00:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7382025-02-21T10:00:53.572ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1251, tv_nsec: 869091228 } })
7392025-02-21T10:00:53.573ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
7402025-02-21T10:00:53.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7412025-02-21T10:00:53.574ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.863498ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7422025-02-21T10:00:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7432025-02-21T10:00:53.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7442025-02-21T10:00:53.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7452025-02-21T10:00:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7462025-02-21T10:00:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7472025-02-21T10:00:53.577ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1251, tv_nsec: 873359231 } })
7482025-02-21T10:00:53.577ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
7492025-02-21T10:00:53.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7502025-02-21T10:00:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7512025-02-21T10:00:53.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7522025-02-21T10:00:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7532025-02-21T10:00:53.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7542025-02-21T10:00:53.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552025-02-21T10:00:53.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7562025-02-21T10:00:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7572025-02-21T10:00:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
7582025-02-21T10:00:53.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7592025-02-21T10:00:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7602025-02-21T10:00:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7612025-02-21T10:00:53.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7622025-02-21T10:00:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7632025-02-21T10:00:53.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
7642025-02-21T10:00:53.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.794331ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
7652025-02-21T10:00:53.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.152863ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
7662025-02-21T10:00:53.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7672025-02-21T10:00:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7682025-02-21T10:00:53.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7692025-02-21T10:00:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7702025-02-21T10:00:53.607ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7712025-02-21T10:00:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7722025-02-21T10:00:53.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7732025-02-21T10:00:53.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7742025-02-21T10:00:53.611ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7752025-02-21T10:00:53.611ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7762025-02-21T10:00:53.611ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7772025-02-21T10:00:53.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7782025-02-21T10:00:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7792025-02-21T10:00:53.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7802025-02-21T10:00:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7812025-02-21T10:00:53.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.521467ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
7822025-02-21T10:00:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7832025-02-21T10:00:53.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7842025-02-21T10:00:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7852025-02-21T10:00:53.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7862025-02-21T10:00:53.615ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7872025-02-21T10:00:53.615ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7882025-02-21T10:00:53.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7892025-02-21T10:00:53.615ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
7902025-02-21T10:00:53.615ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 55.642303ms iteration = 6 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
7912025-02-21T10:00:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7922025-02-21T10:00:53.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7932025-02-21T10:00:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
7942025-02-21T10:00:53.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7952025-02-21T10:00:53.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 58.889251ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7962025-02-21T10:00:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7972025-02-21T10:00:53.619ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 59.449045ms iteration = 6 status = {"errors":[],"requests_created_ok":[]}
7982025-02-21T10:00:53.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7992025-02-21T10:00:53.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8002025-02-21T10:00:53.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8012025-02-21T10:00:53.621ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.254989ms iteration = 6 status = 0
8022025-02-21T10:00:53.625ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8032025-02-21T10:00:53.625ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.884712ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8042025-02-21T10:00:53.650ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8052025-02-21T10:00:53.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8062025-02-21T10:00:53.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.646513ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8072025-02-21T10:00:53.656ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8082025-02-21T10:00:53.656ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8092025-02-21T10:00:53.656ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.943566ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8102025-02-21T10:00:53.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.444451ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8112025-02-21T10:00:53.691ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.987172ms iteration = 8 status = {"physical_disks_added":0}
8122025-02-21T10:00:53.694ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
8132025-02-21T10:00:53.694ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8142025-02-21T10:00:53.694ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8a21e5e-86cb-4bd5-aa3e-29c60fc63e51", "content-length": "26", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8152025-02-21T10:00:53.694ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8162025-02-21T10:00:53.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8172025-02-21T10:00:53.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8182025-02-21T10:00:53.696ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8192025-02-21T10:00:53.729ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8202025-02-21T10:00:53.730ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8212025-02-21T10:00:53.730ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "17727810-5848-4ef2-8d36-4f0d6138c98d", "content-length": "372", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8222025-02-21T10:00:53.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8232025-02-21T10:00:53.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8242025-02-21T10:00:53.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8252025-02-21T10:00:53.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8262025-02-21T10:00:53.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8272025-02-21T10:00:53.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8282025-02-21T10:00:53.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8292025-02-21T10:00:53.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8302025-02-21T10:00:53.737ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8312025-02-21T10:00:53.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8322025-02-21T10:00:53.743ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
8332025-02-21T10:00:53.743ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8342025-02-21T10:00:53.743ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bb86571-71f4-4ae9-81ed-90eaabf1c203", "content-length": "26", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8352025-02-21T10:00:53.743ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8362025-02-21T10:00:53.744ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8372025-02-21T10:00:53.773ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8382025-02-21T10:00:53.773ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8392025-02-21T10:00:53.773ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "549530b0-c583-4c28-b782-be78fe9d566f", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8402025-02-21T10:00:53.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8412025-02-21T10:00:53.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8422025-02-21T10:00:53.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8432025-02-21T10:00:53.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8442025-02-21T10:00:53.777ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
8452025-02-21T10:00:53.777ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8462025-02-21T10:00:53.777ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81ee2821-c023-4bf9-9508-c972826fec88", "content-length": "26", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8472025-02-21T10:00:53.777ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8482025-02-21T10:00:53.779ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
8492025-02-21T10:00:53.786ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8502025-02-21T10:00:53.786ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "77cc394a-1b9b-405e-a7b0-f73ed51626ae", "content-length": "1", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8512025-02-21T10:00:53.788ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8522025-02-21T10:00:53.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8532025-02-21T10:00:53.790ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 229.92736ms iteration = 6 status = null
8542025-02-21T10:00:53.829ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 269.25289ms iteration = 6 status = {}
8552025-02-21T10:00:53.862ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8562025-02-21T10:00:53.862ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d8d89c0-9fbf-4490-a62a-27aeff7f8352", "content-length": "691", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8572025-02-21T10:00:53.862ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8582025-02-21T10:00:53.862ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8592025-02-21T10:00:53.862ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8602025-02-21T10:00:53.864ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 304.407469ms iteration = 6 status = {}
8612025-02-21T10:00:53.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8622025-02-21T10:00:53.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8632025-02-21T10:00:53.886ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8642025-02-21T10:00:53.886ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8652025-02-21T10:00:53.886ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6e0fea19-69b8-4eed-a3c3-9f5ec0668313", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8662025-02-21T10:00:53.888ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 328.398037ms iteration = 6 status = {}
8672025-02-21T10:00:53.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8682025-02-21T10:00:53.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8692025-02-21T10:00:53.919ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
8702025-02-21T10:00:53.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8712025-02-21T10:00:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8722025-02-21T10:00:53.929ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8732025-02-21T10:00:53.930ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a54b59e2-03fd-4746-b27c-ac70fcaa09ca", "content-length": "134", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8742025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8752025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
8762025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8772025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8782025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8792025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8802025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8812025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8822025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8832025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8842025-02-21T10:00:53.930ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
8852025-02-21T10:00:53.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8862025-02-21T10:00:53.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8872025-02-21T10:00:53.932ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8882025-02-21T10:00:53.933ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a50c5225-8a2d-44c6-93d3-9b591c85053a", "content-length": "2", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8892025-02-21T10:00:53.933ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8902025-02-21T10:00:53.933ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "725e4025-c431-4a58-812b-e28fe211d2b7", "content-length": "52", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8912025-02-21T10:00:53.933ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
8922025-02-21T10:00:53.933ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8932025-02-21T10:00:54.034ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fed89b60-6109-442b-8926-c9fba03f863a", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8942025-02-21T10:00:54.034ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
8952025-02-21T10:00:54.034ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8962025-02-21T10:00:54.035ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0c50d03-5aed-4099-8050-bb66ca487b84", "content-length": "682", "date": "Fri, 21 Feb 2025 10:00:53 GMT"} })
8972025-02-21T10:00:54.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8982025-02-21T10:00:54.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8992025-02-21T10:00:54.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9002025-02-21T10:00:54.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9012025-02-21T10:00:54.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9022025-02-21T10:00:54.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9032025-02-21T10:00:54.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9042025-02-21T10:00:54.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9052025-02-21T10:00:54.050ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 490.0247ms iteration = 6 status = {}
9062025-02-21T10:00:54.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b65ede1d-7d8c-4664-9236-9108734ea551 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9072025-02-21T10:00:54.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b65ede1d-7d8c-4664-9236-9108734ea551 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9082025-02-21T10:00:54.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b65ede1d-7d8c-4664-9236-9108734ea551 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9092025-02-21T10:00:55.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a5057d21-c1b2-4ab2-a810-4aefa69e8583 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9102025-02-21T10:00:55.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a5057d21-c1b2-4ab2-a810-4aefa69e8583 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9112025-02-21T10:00:55.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a5057d21-c1b2-4ab2-a810-4aefa69e8583 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9122025-02-21T10:00:56.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 65bbb776-97f3-429e-b021-79bd7a82674f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9132025-02-21T10:00:56.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 65bbb776-97f3-429e-b021-79bd7a82674f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9142025-02-21T10:00:56.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 65bbb776-97f3-429e-b021-79bd7a82674f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9152025-02-21T10:00:56.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 2a3b852e-92da-487e-9251-17fd4f34d682 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
9162025-02-21T10:00:57.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b4590667-af13-4e37-901d-d5a8ab1b860c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9172025-02-21T10:00:57.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b4590667-af13-4e37-901d-d5a8ab1b860c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9182025-02-21T10:00:57.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b4590667-af13-4e37-901d-d5a8ab1b860c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9192025-02-21T10:00:58.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d0b3a086-4307-4e25-aee8-999165da6750 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9202025-02-21T10:00:58.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d0b3a086-4307-4e25-aee8-999165da6750 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9212025-02-21T10:00:58.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2941 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d0b3a086-4307-4e25-aee8-999165da6750 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9222025-02-21T10:00:59.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3fa88ccc-e2ff-4a97-ab92-d2381e56b78a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9232025-02-21T10:00:59.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3fa88ccc-e2ff-4a97-ab92-d2381e56b78a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9242025-02-21T10:00:59.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3fa88ccc-e2ff-4a97-ab92-d2381e56b78a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9252025-02-21T10:01:00.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 05982677-67c8-455a-8e9b-ea53f00cbf7b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9262025-02-21T10:01:00.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 05982677-67c8-455a-8e9b-ea53f00cbf7b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9272025-02-21T10:01:00.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 05982677-67c8-455a-8e9b-ea53f00cbf7b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9282025-02-21T10:01:01.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f31a1988-c412-4cc5-bdca-da4193161e81 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9292025-02-21T10:01:01.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f31a1988-c412-4cc5-bdca-da4193161e81 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9302025-02-21T10:01:01.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f31a1988-c412-4cc5-bdca-da4193161e81 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9312025-02-21T10:01:02.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03a56679-99cb-4feb-9263-f44eb80bd771 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9322025-02-21T10:01:02.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03a56679-99cb-4feb-9263-f44eb80bd771 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9332025-02-21T10:01:02.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03a56679-99cb-4feb-9263-f44eb80bd771 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9342025-02-21T10:01:03.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
9352025-02-21T10:01:03.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9362025-02-21T10:01:03.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
9372025-02-21T10:01:03.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9382025-02-21T10:01:03.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9392025-02-21T10:01:03.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9402025-02-21T10:01:03.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6b48ba4f-8420-4db8-92ad-5698de96c1f8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9412025-02-21T10:01:03.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6b48ba4f-8420-4db8-92ad-5698de96c1f8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9422025-02-21T10:01:03.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6b48ba4f-8420-4db8-92ad-5698de96c1f8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9432025-02-21T10:01:03.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9442025-02-21T10:01:03.591ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9452025-02-21T10:01:03.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9462025-02-21T10:01:03.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9472025-02-21T10:01:03.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9482025-02-21T10:01:03.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9492025-02-21T10:01:03.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9502025-02-21T10:01:03.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9512025-02-21T10:01:03.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9522025-02-21T10:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
9532025-02-21T10:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9542025-02-21T10:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9552025-02-21T10:01:03.609ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
9562025-02-21T10:01:03.609ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.049668ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
9572025-02-21T10:01:03.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.366831ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9582025-02-21T10:01:04.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 666fd95c-95e1-4c1d-bc4a-543dc937f727 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9592025-02-21T10:01:04.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 666fd95c-95e1-4c1d-bc4a-543dc937f727 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9602025-02-21T10:01:04.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 666fd95c-95e1-4c1d-bc4a-543dc937f727 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9612025-02-21T10:01:05.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2c32c4a1-a86a-42e3-9cc3-f2d95fcba3d8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9622025-02-21T10:01:05.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2c32c4a1-a86a-42e3-9cc3-f2d95fcba3d8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9632025-02-21T10:01:05.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2c32c4a1-a86a-42e3-9cc3-f2d95fcba3d8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9642025-02-21T10:01:06.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 630 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = b84ace46-9225-4e93-9e35-728c3c29559e response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
9652025-02-21T10:01:06.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a8b1dd27-186c-490c-acb3-8b84c9ee2fbd roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9662025-02-21T10:01:06.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a8b1dd27-186c-490c-acb3-8b84c9ee2fbd resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9672025-02-21T10:01:06.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1811 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a8b1dd27-186c-490c-acb3-8b84c9ee2fbd response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9682025-02-21T10:01:07.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c43a01b6-d26c-4360-aec2-52a183b3095a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9692025-02-21T10:01:07.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c43a01b6-d26c-4360-aec2-52a183b3095a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9702025-02-21T10:01:07.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c43a01b6-d26c-4360-aec2-52a183b3095a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9712025-02-21T10:01:08.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b96ba60d-78bd-4e36-a2fd-bd295778d5a4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9722025-02-21T10:01:08.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b96ba60d-78bd-4e36-a2fd-bd295778d5a4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9732025-02-21T10:01:08.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2575 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b96ba60d-78bd-4e36-a2fd-bd295778d5a4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9742025-02-21T10:01:09.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9dccd1fb-03e7-4282-a31b-f511393c125b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9752025-02-21T10:01:09.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9dccd1fb-03e7-4282-a31b-f511393c125b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9762025-02-21T10:01:09.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2777 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9dccd1fb-03e7-4282-a31b-f511393c125b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9772025-02-21T10:01:10.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 046670e8-52c9-47db-a0ef-997c37c08759 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9782025-02-21T10:01:10.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 046670e8-52c9-47db-a0ef-997c37c08759 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9792025-02-21T10:01:10.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1816 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 046670e8-52c9-47db-a0ef-997c37c08759 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9802025-02-21T10:01:11.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d511a52b-4138-4042-ab58-d4c20fc23757 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9812025-02-21T10:01:11.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d511a52b-4138-4042-ab58-d4c20fc23757 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9822025-02-21T10:01:11.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1739 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d511a52b-4138-4042-ab58-d4c20fc23757 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9832025-02-21T10:01:12.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f02ff4c7-10e6-4dc7-94eb-746321d48fe9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9842025-02-21T10:01:12.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f02ff4c7-10e6-4dc7-94eb-746321d48fe9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9852025-02-21T10:01:12.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f02ff4c7-10e6-4dc7-94eb-746321d48fe9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
9862025-02-21T10:01:13.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
9872025-02-21T10:01:13.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9882025-02-21T10:01:13.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
9892025-02-21T10:01:13.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9902025-02-21T10:01:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9912025-02-21T10:01:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9922025-02-21T10:01:13.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9932025-02-21T10:01:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9942025-02-21T10:01:13.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9952025-02-21T10:01:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9962025-02-21T10:01:13.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9972025-02-21T10:01:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9982025-02-21T10:01:13.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9992025-02-21T10:01:13.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
10002025-02-21T10:01:13.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10012025-02-21T10:01:13.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10022025-02-21T10:01:13.586ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
10032025-02-21T10:01:13.586ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.476949ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
10042025-02-21T10:01:13.591ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10052025-02-21T10:01:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10062025-02-21T10:01:13.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.576577ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10072025-02-21T10:01:13.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f7aaa18a-0c7f-4532-9ce2-e3b04ad1889b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10082025-02-21T10:01:13.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f7aaa18a-0c7f-4532-9ce2-e3b04ad1889b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10092025-02-21T10:01:13.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1900 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f7aaa18a-0c7f-4532-9ce2-e3b04ad1889b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10102025-02-21T10:01:14.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 52230e89-6daf-47af-bc05-75c9e9fabd47 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10112025-02-21T10:01:14.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 52230e89-6daf-47af-bc05-75c9e9fabd47 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10122025-02-21T10:01:14.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 52230e89-6daf-47af-bc05-75c9e9fabd47 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10132025-02-21T10:01:15.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3089e41b-6296-475c-b97a-12474503b5d2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10142025-02-21T10:01:15.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3089e41b-6296-475c-b97a-12474503b5d2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10152025-02-21T10:01:15.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3089e41b-6296-475c-b97a-12474503b5d2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10162025-02-21T10:01:16.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 458 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = f4252fb8-2489-417e-adf8-080584f251e1 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
10172025-02-21T10:01:16.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d7b34b4c-4036-40b7-ab55-f8ae03849d68 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10182025-02-21T10:01:16.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d7b34b4c-4036-40b7-ab55-f8ae03849d68 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10192025-02-21T10:01:16.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d7b34b4c-4036-40b7-ab55-f8ae03849d68 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10202025-02-21T10:01:17.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ac1abb5a-162d-490e-aa6e-d28aebf537a6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10212025-02-21T10:01:17.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ac1abb5a-162d-490e-aa6e-d28aebf537a6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10222025-02-21T10:01:17.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ac1abb5a-162d-490e-aa6e-d28aebf537a6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10232025-02-21T10:01:18.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e4ed32a2-a8c3-4a65-ab02-882e44720375 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10242025-02-21T10:01:18.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e4ed32a2-a8c3-4a65-ab02-882e44720375 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10252025-02-21T10:01:18.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e4ed32a2-a8c3-4a65-ab02-882e44720375 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10262025-02-21T10:01:19.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f93d2615-3112-4fc7-b974-995bd94994be roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10272025-02-21T10:01:19.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f93d2615-3112-4fc7-b974-995bd94994be resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10282025-02-21T10:01:19.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f93d2615-3112-4fc7-b974-995bd94994be response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10292025-02-21T10:01:20.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9cbbf268-9b9c-4bfb-bec0-dd8f0550ec64 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10302025-02-21T10:01:20.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9cbbf268-9b9c-4bfb-bec0-dd8f0550ec64 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10312025-02-21T10:01:20.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1820 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9cbbf268-9b9c-4bfb-bec0-dd8f0550ec64 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10322025-02-21T10:01:21.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5306cafb-21e1-4f33-9772-38fc384281c2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10332025-02-21T10:01:21.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5306cafb-21e1-4f33-9772-38fc384281c2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10342025-02-21T10:01:21.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5306cafb-21e1-4f33-9772-38fc384281c2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10352025-02-21T10:01:22.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 0268a4c8-600f-46a3-a970-9609be72cd88 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
10362025-02-21T10:01:22.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 0268a4c8-600f-46a3-a970-9609be72cd88 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
10372025-02-21T10:01:23.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4497 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 0268a4c8-600f-46a3-a970-9609be72cd88 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
10382025-02-21T10:01:23.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0e61d307-6b70-4046-9fc9-f0b94c45027a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10392025-02-21T10:01:23.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0e61d307-6b70-4046-9fc9-f0b94c45027a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10402025-02-21T10:01:23.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0e61d307-6b70-4046-9fc9-f0b94c45027a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
10412025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
10422025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10432025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
10442025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10452025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
10462025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10472025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
10482025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10492025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10502025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 7 reason = Timeout
10512025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
10522025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
10532025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
10542025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
10552025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
10562025-02-21T10:01:23.559ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-21 09:51:23.559670328 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10572025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10582025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
10592025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10602025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
10612025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10622025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
10632025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
10642025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10652025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10662025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
10672025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10682025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
10692025-02-21T10:01:23.559ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10702025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10712025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
10722025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10732025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
10742025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10752025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
10762025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
10772025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10782025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
10792025-02-21T10:01:23.559ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041
10802025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.67\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041"}
10812025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
10822025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
10832025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
10842025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10852025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10862025-02-21T10:01:23.559ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10872025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10882025-02-21T10:01:23.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
10892025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
10902025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10912025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10922025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
10932025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
10942025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10952025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10962025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10972025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
10982025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10992025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
11002025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11012025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
11022025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11032025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
11042025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11052025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
11062025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
11072025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11082025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
11092025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11102025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11112025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11122025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11132025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11142025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11152025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
11162025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11172025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11182025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
11192025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11202025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11212025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11222025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11232025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11242025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11252025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11262025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11272025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11282025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11292025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11302025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11312025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11322025-02-21T10:01:23.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3bf841e1-42b9-4bd7-ac20-7644b8a83464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1281, tv_nsec: 856834893 } })
11332025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11342025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11352025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11362025-02-21T10:01:23.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d154e9e-6d90-4040-b311-004f0e299e85.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e63432d-4205-48df-bd2b-03a054e87ab0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1281, tv_nsec: 856859133 } })
11372025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11382025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
11392025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11402025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11412025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11422025-02-21T10:01:23.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11432025-02-21T10:01:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11442025-02-21T10:01:23.561ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11452025-02-21T10:01:23.561ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
11462025-02-21T10:01:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.21989ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
11472025-02-21T10:01:23.561ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
11482025-02-21T10:01:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.480405ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
11492025-02-21T10:01:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11502025-02-21T10:01:23.564ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.067312ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11512025-02-21T10:01:23.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11522025-02-21T10:01:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11532025-02-21T10:01:23.565ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-21 09:51:23.559670328 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11542025-02-21T10:01:23.565ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.596825ms iteration = 4 status = {"expiration":"2025-02-21T09:51:23.559670328Z","pruned":[]}
11552025-02-21T10:01:23.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11562025-02-21T10:01:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11572025-02-21T10:01:23.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11582025-02-21T10:01:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11592025-02-21T10:01:23.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11602025-02-21T10:01:23.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1281, tv_nsec: 866211349 } })
11612025-02-21T10:01:23.570ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
11622025-02-21T10:01:23.572ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11632025-02-21T10:01:23.572ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1281, tv_nsec: 868945445 } })
11642025-02-21T10:01:23.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11652025-02-21T10:01:23.572ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
11662025-02-21T10:01:23.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11672025-02-21T10:01:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11682025-02-21T10:01:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11692025-02-21T10:01:23.574ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11702025-02-21T10:01:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11712025-02-21T10:01:23.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11722025-02-21T10:01:23.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11732025-02-21T10:01:23.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11742025-02-21T10:01:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11752025-02-21T10:01:23.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11762025-02-21T10:01:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11772025-02-21T10:01:23.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11782025-02-21T10:01:23.582ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.258497ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
11792025-02-21T10:01:23.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11802025-02-21T10:01:23.585ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11812025-02-21T10:01:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11822025-02-21T10:01:23.587ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11832025-02-21T10:01:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11842025-02-21T10:01:23.590ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11852025-02-21T10:01:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11862025-02-21T10:01:23.593ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11872025-02-21T10:01:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11882025-02-21T10:01:23.596ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11892025-02-21T10:01:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11902025-02-21T10:01:23.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11912025-02-21T10:01:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11922025-02-21T10:01:23.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11932025-02-21T10:01:23.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11942025-02-21T10:01:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11952025-02-21T10:01:23.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11962025-02-21T10:01:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11972025-02-21T10:01:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11982025-02-21T10:01:23.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11992025-02-21T10:01:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12002025-02-21T10:01:23.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12012025-02-21T10:01:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12022025-02-21T10:01:23.612ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1281, tv_nsec: 909181146 } })
12032025-02-21T10:01:23.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
12042025-02-21T10:01:23.622ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12052025-02-21T10:01:23.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12062025-02-21T10:01:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12072025-02-21T10:01:23.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12082025-02-21T10:01:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12092025-02-21T10:01:23.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12102025-02-21T10:01:23.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.199992ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
12112025-02-21T10:01:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12122025-02-21T10:01:23.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12132025-02-21T10:01:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12142025-02-21T10:01:23.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12152025-02-21T10:01:23.629ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12162025-02-21T10:01:23.629ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12172025-02-21T10:01:23.630ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.749167ms iteration = 7 status = {"errors":[],"requests_created_ok":[]}
12182025-02-21T10:01:23.630ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12192025-02-21T10:01:23.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12202025-02-21T10:01:23.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12212025-02-21T10:01:23.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12222025-02-21T10:01:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12232025-02-21T10:01:23.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12242025-02-21T10:01:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12252025-02-21T10:01:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12262025-02-21T10:01:23.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.10832ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
12272025-02-21T10:01:23.632ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12282025-02-21T10:01:23.632ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12292025-02-21T10:01:23.632ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12302025-02-21T10:01:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12312025-02-21T10:01:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12322025-02-21T10:01:23.632ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12332025-02-21T10:01:23.632ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
12342025-02-21T10:01:23.632ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
12352025-02-21T10:01:23.632ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.221718ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
12362025-02-21T10:01:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12372025-02-21T10:01:23.632ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12382025-02-21T10:01:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12392025-02-21T10:01:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12402025-02-21T10:01:23.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12412025-02-21T10:01:23.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12422025-02-21T10:01:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12432025-02-21T10:01:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12442025-02-21T10:01:23.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12452025-02-21T10:01:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12462025-02-21T10:01:23.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.636015ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12472025-02-21T10:01:23.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12482025-02-21T10:01:23.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12492025-02-21T10:01:23.636ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 77.03137ms iteration = 3 status = {"nsuccess":5}
12502025-02-21T10:01:23.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12512025-02-21T10:01:23.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
12522025-02-21T10:01:23.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12532025-02-21T10:01:23.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12542025-02-21T10:01:23.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12552025-02-21T10:01:23.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12562025-02-21T10:01:23.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.817453ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12572025-02-21T10:01:23.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12582025-02-21T10:01:23.646ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12592025-02-21T10:01:23.646ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12602025-02-21T10:01:23.646ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12612025-02-21T10:01:23.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12622025-02-21T10:01:23.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12632025-02-21T10:01:23.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12642025-02-21T10:01:23.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12652025-02-21T10:01:23.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12662025-02-21T10:01:23.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
12672025-02-21T10:01:23.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.360035ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
12682025-02-21T10:01:23.662ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12692025-02-21T10:01:23.662ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
12702025-02-21T10:01:23.662ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.832052ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
12712025-02-21T10:01:23.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12722025-02-21T10:01:23.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12732025-02-21T10:01:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12742025-02-21T10:01:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12752025-02-21T10:01:23.669ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12762025-02-21T10:01:23.669ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12772025-02-21T10:01:23.669ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12782025-02-21T10:01:23.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12792025-02-21T10:01:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12802025-02-21T10:01:23.670ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12812025-02-21T10:01:23.670ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12822025-02-21T10:01:23.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12832025-02-21T10:01:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12842025-02-21T10:01:23.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12852025-02-21T10:01:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12862025-02-21T10:01:23.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12872025-02-21T10:01:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12882025-02-21T10:01:23.674ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12892025-02-21T10:01:23.674ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12902025-02-21T10:01:23.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12912025-02-21T10:01:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12922025-02-21T10:01:23.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 115.498968ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12932025-02-21T10:01:23.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12942025-02-21T10:01:23.678ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12952025-02-21T10:01:23.678ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.541681ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12962025-02-21T10:01:23.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12972025-02-21T10:01:23.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12982025-02-21T10:01:23.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12992025-02-21T10:01:23.679ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13002025-02-21T10:01:23.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13012025-02-21T10:01:23.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13022025-02-21T10:01:23.680ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13032025-02-21T10:01:23.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13042025-02-21T10:01:23.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13052025-02-21T10:01:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13062025-02-21T10:01:23.681ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13072025-02-21T10:01:23.681ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13082025-02-21T10:01:23.684ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13092025-02-21T10:01:23.684ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13102025-02-21T10:01:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13112025-02-21T10:01:23.684ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13122025-02-21T10:01:23.684ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-21 09:58:29.164998 UTC dns_group = internal generation = 1
13132025-02-21T10:01:23.684ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 124.319041ms iteration = 4 status = {"generation":1}
13142025-02-21T10:01:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13152025-02-21T10:01:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13162025-02-21T10:01:23.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13172025-02-21T10:01:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13182025-02-21T10:01:23.688ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
13192025-02-21T10:01:23.688ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 128.02417ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
13202025-02-21T10:01:23.693ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 133.869162ms iteration = 9 status = {"physical_disks_added":0}
13212025-02-21T10:01:23.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13222025-02-21T10:01:23.699ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
13232025-02-21T10:01:23.700ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13242025-02-21T10:01:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13252025-02-21T10:01:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13262025-02-21T10:01:23.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13272025-02-21T10:01:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13282025-02-21T10:01:23.704ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
13292025-02-21T10:01:23.704ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13302025-02-21T10:01:23.704ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76fa338a-111a-4918-97a9-9414ac946532", "content-length": "26", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
13312025-02-21T10:01:23.704ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13322025-02-21T10:01:23.706ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13332025-02-21T10:01:23.709ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 150.210916ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
13342025-02-21T10:01:23.710ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
13352025-02-21T10:01:23.710ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13362025-02-21T10:01:23.711ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5485e445-a4ff-4545-90f9-585624f8dfb5", "content-length": "26", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
13372025-02-21T10:01:23.711ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13382025-02-21T10:01:23.713ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13392025-02-21T10:01:23.713ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13402025-02-21T10:01:23.713ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 154.017508ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
13412025-02-21T10:01:23.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13422025-02-21T10:01:23.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13432025-02-21T10:01:23.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13442025-02-21T10:01:23.737ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13452025-02-21T10:01:23.737ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 0 version = 2
13462025-02-21T10:01:23.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13472025-02-21T10:01:23.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13482025-02-21T10:01:23.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13492025-02-21T10:01:23.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13502025-02-21T10:01:23.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13512025-02-21T10:01:23.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13522025-02-21T10:01:23.744ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 1 version = 2
13532025-02-21T10:01:23.744ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13542025-02-21T10:01:23.744ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-21 09:58:29.727106 UTC dns_group = external generation = 2
13552025-02-21T10:01:23.744ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 185.107498ms iteration = 4 status = {"generation":2}
13562025-02-21T10:01:23.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
13572025-02-21T10:01:23.745ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13582025-02-21T10:01:23.745ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d58e9ec-2aeb-40c6-afef-754684efc7f5", "content-length": "26", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
13592025-02-21T10:01:23.745ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13602025-02-21T10:01:23.747ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
13612025-02-21T10:01:23.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13622025-02-21T10:01:23.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13632025-02-21T10:01:23.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13642025-02-21T10:01:23.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13652025-02-21T10:01:23.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13662025-02-21T10:01:23.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
13672025-02-21T10:01:23.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13682025-02-21T10:01:23.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13692025-02-21T10:01:23.768ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 209.308233ms iteration = 7 status = 0
13702025-02-21T10:01:23.769ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13712025-02-21T10:01:23.769ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
13722025-02-21T10:01:23.769ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 209.787025ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
13732025-02-21T10:01:23.770ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13742025-02-21T10:01:23.770ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13752025-02-21T10:01:23.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13762025-02-21T10:01:23.806ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-21T09:58:18.895783Z, time_modified: 2025-02-21T09:58:18.895783Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }) }
13772025-02-21T10:01:23.806ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 246.507761ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]}},"default_endpoint":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13782025-02-21T10:01:23.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13792025-02-21T10:01:23.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13802025-02-21T10:01:23.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13812025-02-21T10:01:23.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13822025-02-21T10:01:23.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13832025-02-21T10:01:23.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13842025-02-21T10:01:23.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13852025-02-21T10:01:23.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13862025-02-21T10:01:23.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13872025-02-21T10:01:23.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13882025-02-21T10:01:23.846ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13892025-02-21T10:01:23.854ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13902025-02-21T10:01:23.855ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b1d5915e-a231-487c-aed8-272af96450f3", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13912025-02-21T10:01:23.855ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13922025-02-21T10:01:23.856ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1ebfcbfc-0c8b-49fd-b39e-3aaefe7ce906", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13932025-02-21T10:01:23.856ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13942025-02-21T10:01:23.858ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13952025-02-21T10:01:23.858ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 298.779583ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13962025-02-21T10:01:23.858ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13972025-02-21T10:01:23.858ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "29ed6c3a-ef8c-45f0-bdac-93977dfa7ebb", "content-length": "1", "date": "Fri, 21 Feb 2025 10:01:22 GMT"} })
13982025-02-21T10:01:23.859ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13992025-02-21T10:01:23.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14002025-02-21T10:01:23.861ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 301.815486ms iteration = 7 status = null
14012025-02-21T10:01:23.909ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14022025-02-21T10:01:23.909ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14032025-02-21T10:01:23.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "921dcc97-3cc2-498f-ba8a-92e29195b026", "content-length": "372", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
14042025-02-21T10:01:23.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14052025-02-21T10:01:23.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14062025-02-21T10:01:23.939ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 380.004694ms iteration = 7 status = {}
14072025-02-21T10:01:23.951ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14082025-02-21T10:01:23.951ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "58b72999-dd74-4d3b-b701-490f64323b1b", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14092025-02-21T10:01:23.951ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14102025-02-21T10:01:23.953ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "451463bf-a86d-4678-b074-c34e97d37483", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14112025-02-21T10:01:23.953ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14122025-02-21T10:01:23.954ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1a146344-ab06-430c-a725-e2876443f5f4", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14132025-02-21T10:01:23.954ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14142025-02-21T10:01:23.955ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14152025-02-21T10:01:23.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 396.193605ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14162025-02-21T10:01:23.960ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
14172025-02-21T10:01:23.960ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14182025-02-21T10:01:23.960ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "80b40720-c7c3-46f9-8cee-8199e0f81602", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
14192025-02-21T10:01:23.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14202025-02-21T10:01:23.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14212025-02-21T10:01:23.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14222025-02-21T10:01:23.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14232025-02-21T10:01:23.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14242025-02-21T10:01:23.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14252025-02-21T10:01:23.970ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14262025-02-21T10:01:23.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14272025-02-21T10:01:23.970ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9e7b2da9-f1d2-45c4-8c60-dd99bcc542dd", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
14282025-02-21T10:01:23.971ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14292025-02-21T10:01:23.971ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a39fa10d-26e8-492e-b19f-5722d1329064", "content-length": "691", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
14302025-02-21T10:01:23.971ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14312025-02-21T10:01:23.971ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14322025-02-21T10:01:23.971ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14332025-02-21T10:01:23.973ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 413.39612ms iteration = 7 status = {}
14342025-02-21T10:01:23.973ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 413.553683ms iteration = 7 status = {}
14352025-02-21T10:01:24.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14362025-02-21T10:01:24.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14372025-02-21T10:01:24.025ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
14382025-02-21T10:01:24.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14392025-02-21T10:01:24.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14402025-02-21T10:01:24.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b1752082-64ae-4f6c-a2d4-9db058fe3040 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14412025-02-21T10:01:24.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b1752082-64ae-4f6c-a2d4-9db058fe3040 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14422025-02-21T10:01:24.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b1752082-64ae-4f6c-a2d4-9db058fe3040 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14432025-02-21T10:01:24.036ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14442025-02-21T10:01:24.036ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6d7816b-6ee1-43b9-b625-4056100ca0a9", "content-length": "134", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
14452025-02-21T10:01:24.036ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
14462025-02-21T10:01:24.036ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
14472025-02-21T10:01:24.036ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14482025-02-21T10:01:24.036ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14492025-02-21T10:01:24.036ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14502025-02-21T10:01:24.036ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14512025-02-21T10:01:24.036ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14522025-02-21T10:01:24.036ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14532025-02-21T10:01:24.037ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14542025-02-21T10:01:24.037ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14552025-02-21T10:01:24.037ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
14562025-02-21T10:01:24.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14572025-02-21T10:01:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14582025-02-21T10:01:24.039ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14592025-02-21T10:01:24.040ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ba88c19-8ccf-4fda-bcd6-79056e242665", "content-length": "2", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
14602025-02-21T10:01:24.040ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14612025-02-21T10:01:24.040ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0398fecf-524e-44bb-9c67-41906277d58d", "content-length": "52", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
14622025-02-21T10:01:24.040ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
14632025-02-21T10:01:24.040ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14642025-02-21T10:01:24.134ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bbf85cb9-478c-43e2-a20a-9b8d163ae29a", "date": "Fri, 21 Feb 2025 10:01:23 GMT"} })
14652025-02-21T10:01:24.134ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
14662025-02-21T10:01:24.134ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14672025-02-21T10:01:24.134ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d203a2b0-b052-42d6-930c-3533f5dc93dc", "content-length": "682", "date": "Fri, 21 Feb 2025 10:01:24 GMT"} })
14682025-02-21T10:01:24.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14692025-02-21T10:01:24.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14702025-02-21T10:01:24.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14712025-02-21T10:01:24.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14722025-02-21T10:01:24.141ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14732025-02-21T10:01:24.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14742025-02-21T10:01:24.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14752025-02-21T10:01:24.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14762025-02-21T10:01:24.151ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 591.202272ms iteration = 7 status = {}
14772025-02-21T10:01:25.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6634f40e-72a4-4110-bb3b-ec78a4f69ff9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14782025-02-21T10:01:25.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6634f40e-72a4-4110-bb3b-ec78a4f69ff9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14792025-02-21T10:01:25.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2689 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6634f40e-72a4-4110-bb3b-ec78a4f69ff9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14802025-02-21T10:01:26.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 41d6e414-9533-43c4-a487-44f6b9ebd514 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14812025-02-21T10:01:26.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 41d6e414-9533-43c4-a487-44f6b9ebd514 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14822025-02-21T10:01:26.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2492 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 41d6e414-9533-43c4-a487-44f6b9ebd514 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14832025-02-21T10:01:26.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 550 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = b95bcca3-bec3-49e4-806f-051d24543c57 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
14842025-02-21T10:01:27.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 01b1dce0-74d1-4215-912b-d137c9c7d128 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14852025-02-21T10:01:27.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 01b1dce0-74d1-4215-912b-d137c9c7d128 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14862025-02-21T10:01:27.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 01b1dce0-74d1-4215-912b-d137c9c7d128 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14872025-02-21T10:01:28.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d8ece9e7-c953-433e-9db6-f256e208bf48 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14882025-02-21T10:01:28.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d8ece9e7-c953-433e-9db6-f256e208bf48 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14892025-02-21T10:01:28.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d8ece9e7-c953-433e-9db6-f256e208bf48 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14902025-02-21T10:01:29.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 11e00b60-3ab8-450f-b7c1-1598e0fd9696 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14912025-02-21T10:01:29.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 11e00b60-3ab8-450f-b7c1-1598e0fd9696 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14922025-02-21T10:01:29.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 11e00b60-3ab8-450f-b7c1-1598e0fd9696 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14932025-02-21T10:01:30.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9d009238-409f-4856-bfc4-fa19bb6c2e62 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14942025-02-21T10:01:30.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9d009238-409f-4856-bfc4-fa19bb6c2e62 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14952025-02-21T10:01:30.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2896 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9d009238-409f-4856-bfc4-fa19bb6c2e62 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14962025-02-21T10:01:31.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cf2c707b-66d4-4f3f-9439-5c3962e51fb8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14972025-02-21T10:01:31.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cf2c707b-66d4-4f3f-9439-5c3962e51fb8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14982025-02-21T10:01:31.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1898 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cf2c707b-66d4-4f3f-9439-5c3962e51fb8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
14992025-02-21T10:01:32.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb25e318-63d3-47f2-aa93-97d6c9312ba5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15002025-02-21T10:01:32.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb25e318-63d3-47f2-aa93-97d6c9312ba5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15012025-02-21T10:01:32.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb25e318-63d3-47f2-aa93-97d6c9312ba5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15022025-02-21T10:01:33.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 93d61929-0377-4da1-89bf-43d689a340d2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15032025-02-21T10:01:33.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 93d61929-0377-4da1-89bf-43d689a340d2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15042025-02-21T10:01:33.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2052 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 93d61929-0377-4da1-89bf-43d689a340d2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15052025-02-21T10:01:33.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
15062025-02-21T10:01:33.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
15072025-02-21T10:01:33.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15082025-02-21T10:01:33.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15092025-02-21T10:01:33.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15102025-02-21T10:01:33.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15112025-02-21T10:01:33.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15122025-02-21T10:01:33.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15132025-02-21T10:01:33.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15142025-02-21T10:01:33.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15152025-02-21T10:01:33.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15162025-02-21T10:01:33.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15172025-02-21T10:01:33.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15182025-02-21T10:01:33.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
15192025-02-21T10:01:33.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15202025-02-21T10:01:33.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15212025-02-21T10:01:33.584ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
15222025-02-21T10:01:33.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.560363ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
15232025-02-21T10:01:33.596ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15242025-02-21T10:01:33.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15252025-02-21T10:01:33.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.780747ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15262025-02-21T10:01:34.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 68577bc2-1ccb-493e-9bea-2f3eb4ff4649 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15272025-02-21T10:01:34.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 68577bc2-1ccb-493e-9bea-2f3eb4ff4649 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15282025-02-21T10:01:34.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 68577bc2-1ccb-493e-9bea-2f3eb4ff4649 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15292025-02-21T10:01:35.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84868f06-ef04-440e-b646-194ea27e2673 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15302025-02-21T10:01:35.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84868f06-ef04-440e-b646-194ea27e2673 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15312025-02-21T10:01:35.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84868f06-ef04-440e-b646-194ea27e2673 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15322025-02-21T10:01:36.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d5babefc-81d4-403a-97b8-3d1a42d6d814 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15332025-02-21T10:01:36.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d5babefc-81d4-403a-97b8-3d1a42d6d814 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15342025-02-21T10:01:36.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d5babefc-81d4-403a-97b8-3d1a42d6d814 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15352025-02-21T10:01:36.538ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:43113
15362025-02-21T10:01:36.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 1861635b-b130-4dd5-a459-adcf5dd2d945 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
15372025-02-21T10:01:36.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 1861635b-b130-4dd5-a459-adcf5dd2d945 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
15382025-02-21T10:01:36.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3260 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 1861635b-b130-4dd5-a459-adcf5dd2d945 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
15392025-02-21T10:01:36.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 11e0a96b-042e-4536-95bd-750cc4e89d51 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
15402025-02-21T10:01:36.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 11e0a96b-042e-4536-95bd-750cc4e89d51 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
15412025-02-21T10:01:36.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 11e0a96b-042e-4536-95bd-750cc4e89d51 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
15422025-02-21T10:01:36.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 466 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 94f79744-ece0-4eaa-8bd3-732337dcd0cd response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
15432025-02-21T10:01:37.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a35c7d46-56c3-4e3c-8ace-bbcedd79bafa roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15442025-02-21T10:01:37.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a35c7d46-56c3-4e3c-8ace-bbcedd79bafa resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15452025-02-21T10:01:37.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a35c7d46-56c3-4e3c-8ace-bbcedd79bafa response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15462025-02-21T10:01:38.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = db64da9f-0001-4eeb-9a0b-e941cf7b8ad8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15472025-02-21T10:01:38.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = db64da9f-0001-4eeb-9a0b-e941cf7b8ad8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15482025-02-21T10:01:38.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = db64da9f-0001-4eeb-9a0b-e941cf7b8ad8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15492025-02-21T10:01:39.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2cd5655d-6fdd-4ca0-8424-e1fd8d700566 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15502025-02-21T10:01:39.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2cd5655d-6fdd-4ca0-8424-e1fd8d700566 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15512025-02-21T10:01:39.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2cd5655d-6fdd-4ca0-8424-e1fd8d700566 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15522025-02-21T10:01:40.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9ebd97dc-0661-4872-b6bb-ba7b2d2f1d87 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15532025-02-21T10:01:40.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9ebd97dc-0661-4872-b6bb-ba7b2d2f1d87 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15542025-02-21T10:01:40.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2504 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9ebd97dc-0661-4872-b6bb-ba7b2d2f1d87 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15552025-02-21T10:01:41.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 54519179-6016-4347-9427-83237190ce3b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15562025-02-21T10:01:41.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 54519179-6016-4347-9427-83237190ce3b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15572025-02-21T10:01:41.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 54519179-6016-4347-9427-83237190ce3b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15582025-02-21T10:01:42.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f4bc5eb0-b42c-4356-b79a-6c901294d3bb roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15592025-02-21T10:01:42.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f4bc5eb0-b42c-4356-b79a-6c901294d3bb resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15602025-02-21T10:01:42.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f4bc5eb0-b42c-4356-b79a-6c901294d3bb response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15612025-02-21T10:01:43.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 26412521-a386-42ca-b25c-3ac338bd2fa8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15622025-02-21T10:01:43.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 26412521-a386-42ca-b25c-3ac338bd2fa8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15632025-02-21T10:01:43.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 26412521-a386-42ca-b25c-3ac338bd2fa8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15642025-02-21T10:01:43.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
15652025-02-21T10:01:43.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15662025-02-21T10:01:43.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
15672025-02-21T10:01:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15682025-02-21T10:01:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15692025-02-21T10:01:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15702025-02-21T10:01:43.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712025-02-21T10:01:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15722025-02-21T10:01:43.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15732025-02-21T10:01:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15742025-02-21T10:01:43.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15752025-02-21T10:01:43.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15762025-02-21T10:01:43.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15772025-02-21T10:01:43.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
15782025-02-21T10:01:43.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15792025-02-21T10:01:43.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15802025-02-21T10:01:43.581ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
15812025-02-21T10:01:43.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.709488ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
15822025-02-21T10:01:43.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15832025-02-21T10:01:43.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15842025-02-21T10:01:43.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.426366ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15852025-02-21T10:01:44.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7cf22534-59f7-4937-a026-4f2c31400a77 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15862025-02-21T10:01:44.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7cf22534-59f7-4937-a026-4f2c31400a77 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15872025-02-21T10:01:44.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1932 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7cf22534-59f7-4937-a026-4f2c31400a77 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15882025-02-21T10:01:45.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d0bf697-cf2e-47be-92c1-2e71e9f0a637 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15892025-02-21T10:01:45.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d0bf697-cf2e-47be-92c1-2e71e9f0a637 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15902025-02-21T10:01:45.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d0bf697-cf2e-47be-92c1-2e71e9f0a637 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15912025-02-21T10:01:46.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 875 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 14bf897c-7089-490b-91ae-a16ccbd500c9 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
15922025-02-21T10:01:46.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4789c97d-5a8f-420d-b49d-4e8b8fd95de8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15932025-02-21T10:01:46.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4789c97d-5a8f-420d-b49d-4e8b8fd95de8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15942025-02-21T10:01:46.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4789c97d-5a8f-420d-b49d-4e8b8fd95de8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15952025-02-21T10:01:47.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cbc8785b-a9dd-4cba-a8bb-2c4e4bcd32c0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15962025-02-21T10:01:47.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cbc8785b-a9dd-4cba-a8bb-2c4e4bcd32c0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15972025-02-21T10:01:47.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2474 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cbc8785b-a9dd-4cba-a8bb-2c4e4bcd32c0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15982025-02-21T10:01:48.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 16baa95b-df5d-4b25-a26b-5fe90bd0bc63 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
15992025-02-21T10:01:48.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 16baa95b-df5d-4b25-a26b-5fe90bd0bc63 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16002025-02-21T10:01:48.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 16baa95b-df5d-4b25-a26b-5fe90bd0bc63 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16012025-02-21T10:01:49.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84902fdb-5727-4536-8516-26793951d25a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16022025-02-21T10:01:49.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84902fdb-5727-4536-8516-26793951d25a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16032025-02-21T10:01:49.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84902fdb-5727-4536-8516-26793951d25a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16042025-02-21T10:01:50.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f8e772f2-21b2-4a4d-acc7-26df6e76b9b8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16052025-02-21T10:01:50.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f8e772f2-21b2-4a4d-acc7-26df6e76b9b8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16062025-02-21T10:01:50.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2423 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f8e772f2-21b2-4a4d-acc7-26df6e76b9b8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16072025-02-21T10:01:51.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1cdb7bda-400f-40e2-8ecf-27cd528a1472 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16082025-02-21T10:01:51.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1cdb7bda-400f-40e2-8ecf-27cd528a1472 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16092025-02-21T10:01:51.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1997 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1cdb7bda-400f-40e2-8ecf-27cd528a1472 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16102025-02-21T10:01:52.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3ff113df-c22d-4082-b281-ef8dbd306b04 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16112025-02-21T10:01:52.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3ff113df-c22d-4082-b281-ef8dbd306b04 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16122025-02-21T10:01:52.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1819 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3ff113df-c22d-4082-b281-ef8dbd306b04 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
16132025-02-21T10:01:53.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 9bedf025-12e8-4ffb-8c3f-8b7583171349 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
16142025-02-21T10:01:53.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 9bedf025-12e8-4ffb-8c3f-8b7583171349 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
16152025-02-21T10:01:53.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3704 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 9bedf025-12e8-4ffb-8c3f-8b7583171349 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
16162025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
16172025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16182025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
16192025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
16202025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16212025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16222025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
16232025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 8 reason = Timeout
16242025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
16252025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16262025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
16272025-02-21T10:01:53.560ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16282025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
16292025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16302025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16312025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
16322025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16332025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
16342025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16352025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
16362025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16372025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16382025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
16392025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16402025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
16412025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16422025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
16432025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16442025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
16452025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
16462025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16472025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
16482025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16492025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
16502025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
16512025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16522025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16532025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
16542025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16552025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16562025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16572025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16582025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
16592025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16602025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16612025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16622025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16632025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16642025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16652025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16662025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16672025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16682025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16692025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16702025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16712025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16722025-02-21T10:01:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16732025-02-21T10:01:53.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16742025-02-21T10:01:53.563ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.054614ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16752025-02-21T10:01:53.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16762025-02-21T10:01:53.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16772025-02-21T10:01:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16782025-02-21T10:01:53.565ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16792025-02-21T10:01:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16802025-02-21T10:01:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16812025-02-21T10:01:53.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16822025-02-21T10:01:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16832025-02-21T10:01:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16842025-02-21T10:01:53.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16852025-02-21T10:01:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16862025-02-21T10:01:53.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16872025-02-21T10:01:53.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.886814ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
16882025-02-21T10:01:53.569ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16892025-02-21T10:01:53.569ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16902025-02-21T10:01:53.569ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16912025-02-21T10:01:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16922025-02-21T10:01:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16932025-02-21T10:01:53.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16942025-02-21T10:01:53.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16952025-02-21T10:01:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16962025-02-21T10:01:53.572ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16972025-02-21T10:01:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16982025-02-21T10:01:53.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16992025-02-21T10:01:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17002025-02-21T10:01:53.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1311, tv_nsec: 870267106 } })
17012025-02-21T10:01:53.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1311, tv_nsec: 870373489 } })
17022025-02-21T10:01:53.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
17032025-02-21T10:01:53.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
17042025-02-21T10:01:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17052025-02-21T10:01:53.574ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17062025-02-21T10:01:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17072025-02-21T10:01:53.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.018262ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
17082025-02-21T10:01:53.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17092025-02-21T10:01:53.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17102025-02-21T10:01:53.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17112025-02-21T10:01:53.578ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17122025-02-21T10:01:53.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17132025-02-21T10:01:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17142025-02-21T10:01:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17152025-02-21T10:01:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17162025-02-21T10:01:53.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1311, tv_nsec: 876318583 } })
17172025-02-21T10:01:53.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
17182025-02-21T10:01:53.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17192025-02-21T10:01:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17202025-02-21T10:01:53.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17212025-02-21T10:01:53.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17222025-02-21T10:01:53.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17232025-02-21T10:01:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17242025-02-21T10:01:53.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17252025-02-21T10:01:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17262025-02-21T10:01:53.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.94159ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17272025-02-21T10:01:53.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17282025-02-21T10:01:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17292025-02-21T10:01:53.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17302025-02-21T10:01:53.616ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 55.94734ms iteration = 8 status = {"errors":[],"requests_created_ok":[]}
17312025-02-21T10:01:53.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17322025-02-21T10:01:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17332025-02-21T10:01:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17342025-02-21T10:01:53.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.988545ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17352025-02-21T10:01:53.617ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17362025-02-21T10:01:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17372025-02-21T10:01:53.618ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17382025-02-21T10:01:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17392025-02-21T10:01:53.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17402025-02-21T10:01:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17412025-02-21T10:01:53.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17422025-02-21T10:01:53.622ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17432025-02-21T10:01:53.622ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.317824ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17442025-02-21T10:01:53.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
17452025-02-21T10:01:53.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17462025-02-21T10:01:53.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17472025-02-21T10:01:53.626ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 66.202238ms iteration = 8 status = 0
17482025-02-21T10:01:53.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17492025-02-21T10:01:53.630ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17502025-02-21T10:01:53.630ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17512025-02-21T10:01:53.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17522025-02-21T10:01:53.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17532025-02-21T10:01:53.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
17542025-02-21T10:01:53.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17552025-02-21T10:01:53.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17562025-02-21T10:01:53.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17572025-02-21T10:01:53.632ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17582025-02-21T10:01:53.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17592025-02-21T10:01:53.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17602025-02-21T10:01:53.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17612025-02-21T10:01:53.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17622025-02-21T10:01:53.634ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17632025-02-21T10:01:53.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17642025-02-21T10:01:53.636ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17652025-02-21T10:01:53.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17662025-02-21T10:01:53.640ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
17672025-02-21T10:01:53.640ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.127634ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
17682025-02-21T10:01:53.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 90.69556ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17692025-02-21T10:01:53.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.852101ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
17702025-02-21T10:01:53.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17712025-02-21T10:01:53.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17722025-02-21T10:01:53.670ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17732025-02-21T10:01:53.670ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17742025-02-21T10:01:53.670ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.430215ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17752025-02-21T10:01:53.671ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
17762025-02-21T10:01:53.671ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 111.289197ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
17772025-02-21T10:01:53.673ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
17782025-02-21T10:01:53.673ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17792025-02-21T10:01:53.673ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b69d6b5d-3a07-4e21-9447-b734b288c35e", "content-length": "26", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
17802025-02-21T10:01:53.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17812025-02-21T10:01:53.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17822025-02-21T10:01:53.678ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
17832025-02-21T10:01:53.678ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17842025-02-21T10:01:53.678ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3487b0a-ba50-4154-9d2f-d94522610983", "content-length": "26", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
17852025-02-21T10:01:53.678ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17862025-02-21T10:01:53.679ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
17872025-02-21T10:01:53.679ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17882025-02-21T10:01:53.679ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "278f11f9-3932-4712-9750-f9a28748b3d4", "content-length": "26", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
17892025-02-21T10:01:53.679ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17902025-02-21T10:01:53.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17912025-02-21T10:01:53.681ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
17922025-02-21T10:01:53.740ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 180.244461ms iteration = 10 status = {"physical_disks_added":0}
17932025-02-21T10:01:53.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = db5db19d-d7b0-4f26-8161-8698cbe9ec9d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
17942025-02-21T10:01:53.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = db5db19d-d7b0-4f26-8161-8698cbe9ec9d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
17952025-02-21T10:01:53.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = db5db19d-d7b0-4f26-8161-8698cbe9ec9d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
17962025-02-21T10:01:53.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17972025-02-21T10:01:53.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17982025-02-21T10:01:53.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17992025-02-21T10:01:53.758ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18002025-02-21T10:01:53.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18012025-02-21T10:01:53.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18022025-02-21T10:01:53.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18032025-02-21T10:01:53.761ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18042025-02-21T10:01:53.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18052025-02-21T10:01:53.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18062025-02-21T10:01:53.796ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
18072025-02-21T10:01:53.796ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18082025-02-21T10:01:53.797ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "83f328fb-20d0-4c92-abcf-0c917710c1cc", "content-length": "372", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
18092025-02-21T10:01:53.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18102025-02-21T10:01:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18112025-02-21T10:01:53.803ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18122025-02-21T10:01:53.804ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b227ae56-4492-47a9-962d-029f7e8bff5a", "content-length": "1", "date": "Fri, 21 Feb 2025 10:01:52 GMT"} })
18132025-02-21T10:01:53.805ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 244.936773ms iteration = 8 status = {}
18142025-02-21T10:01:53.806ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18152025-02-21T10:01:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18162025-02-21T10:01:53.807ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 247.449684ms iteration = 8 status = null
18172025-02-21T10:01:53.841ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
18182025-02-21T10:01:53.841ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18192025-02-21T10:01:53.843ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "75cccdfd-ec95-48c5-98bc-229000e32a1d", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
18202025-02-21T10:01:53.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18212025-02-21T10:01:53.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18222025-02-21T10:01:53.846ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18232025-02-21T10:01:53.846ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0abcf50-eb6c-413f-9f1a-5df0d444a6d9", "content-length": "691", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
18242025-02-21T10:01:53.846ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18252025-02-21T10:01:53.846ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18262025-02-21T10:01:53.846ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18272025-02-21T10:01:53.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18282025-02-21T10:01:53.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18292025-02-21T10:01:53.848ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 288.383611ms iteration = 8 status = {}
18302025-02-21T10:01:53.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18312025-02-21T10:01:53.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18322025-02-21T10:01:53.854ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18332025-02-21T10:01:53.854ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18342025-02-21T10:01:53.854ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "16058e16-4c91-4d97-be82-d042e2932244", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
18352025-02-21T10:01:53.855ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 295.470843ms iteration = 8 status = {}
18362025-02-21T10:01:53.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18372025-02-21T10:01:53.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18382025-02-21T10:01:53.890ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
18392025-02-21T10:01:53.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18402025-02-21T10:01:53.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18412025-02-21T10:01:53.899ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18422025-02-21T10:01:53.899ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c39a1f6c-28e1-4ed9-a9d4-66860f387cb6", "content-length": "134", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
18432025-02-21T10:01:53.899ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18442025-02-21T10:01:53.899ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
18452025-02-21T10:01:53.899ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18462025-02-21T10:01:53.899ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18472025-02-21T10:01:53.899ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18482025-02-21T10:01:53.899ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18492025-02-21T10:01:53.899ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18502025-02-21T10:01:53.899ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18512025-02-21T10:01:53.900ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18522025-02-21T10:01:53.900ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18532025-02-21T10:01:53.900ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
18542025-02-21T10:01:53.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18552025-02-21T10:01:53.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18562025-02-21T10:01:53.902ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18572025-02-21T10:01:53.902ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3ac30dd-dac4-42d8-bad1-0dd09f55fa72", "content-length": "2", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
18582025-02-21T10:01:53.902ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18592025-02-21T10:01:53.902ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "863cc63b-f6ce-4905-bc5d-c1799b892400", "content-length": "52", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
18602025-02-21T10:01:53.902ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
18612025-02-21T10:01:53.902ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18622025-02-21T10:01:53.995ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d54001dd-f38d-4c2b-81c9-5c38ae551b1b", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
18632025-02-21T10:01:53.995ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
18642025-02-21T10:01:53.995ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18652025-02-21T10:01:53.995ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3f46776-d9e1-4e7a-8a6d-3473ae20fe13", "content-length": "682", "date": "Fri, 21 Feb 2025 10:01:53 GMT"} })
18662025-02-21T10:01:53.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18672025-02-21T10:01:53.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18682025-02-21T10:01:53.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18692025-02-21T10:01:54.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18702025-02-21T10:01:54.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18712025-02-21T10:01:54.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18722025-02-21T10:01:54.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18732025-02-21T10:01:54.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18742025-02-21T10:01:54.012ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 452.35756ms iteration = 8 status = {}
18752025-02-21T10:01:54.062ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
18762025-02-21T10:01:54.062ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
18772025-02-21T10:01:54.093ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
18782025-02-21T10:01:54.093ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:47248
18792025-02-21T10:01:54.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:47248 req_id = bd4722f0-6e40-41b5-aa44-7a6f54115d09 roles = RoleSet { roles: {} } uri = /metrics/producers
18802025-02-21T10:01:54.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:47248 req_id = bd4722f0-6e40-41b5-aa44-7a6f54115d09 resource = Database result = Ok(()) uri = /metrics/producers
18812025-02-21T10:01:54.130ZINFOnexus: assigned collector to new producer collector_id = 8d248760-b8d2-4503-94cf-92f282d79332 file = nexus/src/app/oximeter.rs:76 producer_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
18822025-02-21T10:01:54.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 36996 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:47248 req_id = bd4722f0-6e40-41b5-aa44-7a6f54115d09 response_code = 201 uri = /metrics/producers
18832025-02-21T10:01:54.130ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bd4722f0-6e40-41b5-aa44-7a6f54115d09", "content-length": "41", "date": "Fri, 21 Feb 2025 10:01:54 GMT"} })
18842025-02-21T10:01:54.132ZDEBGnexus (producer-registration-task): registered with nexus successfully
18852025-02-21T10:01:54.132ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
18862025-02-21T10:01:54.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5817f894-0c49-43e7-8517-a045a82de446 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18872025-02-21T10:01:54.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5817f894-0c49-43e7-8517-a045a82de446 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18882025-02-21T10:01:54.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2024 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5817f894-0c49-43e7-8517-a045a82de446 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18892025-02-21T10:01:55.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 22f2879b-3296-4a96-8038-2e1309d26823 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18902025-02-21T10:01:55.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 22f2879b-3296-4a96-8038-2e1309d26823 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18912025-02-21T10:01:55.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 22f2879b-3296-4a96-8038-2e1309d26823 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18922025-02-21T10:01:56.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 872 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 299251bf-43a8-45e0-81a1-883e37689fd8 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
18932025-02-21T10:01:56.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8dde54cf-0714-4f2e-b05c-88760367d15f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18942025-02-21T10:01:56.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8dde54cf-0714-4f2e-b05c-88760367d15f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18952025-02-21T10:01:56.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1961 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8dde54cf-0714-4f2e-b05c-88760367d15f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18962025-02-21T10:01:57.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a57a8fe1-ebaa-4060-a279-a0f7dd4238b7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18972025-02-21T10:01:57.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a57a8fe1-ebaa-4060-a279-a0f7dd4238b7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18982025-02-21T10:01:57.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a57a8fe1-ebaa-4060-a279-a0f7dd4238b7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
18992025-02-21T10:01:58.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a6110344-604a-458d-ac34-c47a2629c2e2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19002025-02-21T10:01:58.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a6110344-604a-458d-ac34-c47a2629c2e2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19012025-02-21T10:01:58.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2825 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a6110344-604a-458d-ac34-c47a2629c2e2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19022025-02-21T10:01:59.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29d54f85-9f67-42e5-b32d-bbfbf51404df roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19032025-02-21T10:01:59.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29d54f85-9f67-42e5-b32d-bbfbf51404df resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19042025-02-21T10:01:59.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29d54f85-9f67-42e5-b32d-bbfbf51404df response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19052025-02-21T10:02:00.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 32d4302e-3068-408a-a14d-51a94cc46842 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19062025-02-21T10:02:00.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 32d4302e-3068-408a-a14d-51a94cc46842 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19072025-02-21T10:02:00.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 32d4302e-3068-408a-a14d-51a94cc46842 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19082025-02-21T10:02:01.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = afdebdd1-bc58-4b26-9175-deccc7e3838b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19092025-02-21T10:02:01.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = afdebdd1-bc58-4b26-9175-deccc7e3838b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19102025-02-21T10:02:01.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = afdebdd1-bc58-4b26-9175-deccc7e3838b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19112025-02-21T10:02:02.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0251ef0e-7909-4b55-87c9-bf8b7a24b838 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19122025-02-21T10:02:02.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0251ef0e-7909-4b55-87c9-bf8b7a24b838 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19132025-02-21T10:02:02.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2556 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0251ef0e-7909-4b55-87c9-bf8b7a24b838 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19142025-02-21T10:02:03.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
19152025-02-21T10:02:03.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19162025-02-21T10:02:03.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
19172025-02-21T10:02:03.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19182025-02-21T10:02:03.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19192025-02-21T10:02:03.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19202025-02-21T10:02:03.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19212025-02-21T10:02:03.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19222025-02-21T10:02:03.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19232025-02-21T10:02:03.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19242025-02-21T10:02:03.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19252025-02-21T10:02:03.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19262025-02-21T10:02:03.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19272025-02-21T10:02:03.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19282025-02-21T10:02:03.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19292025-02-21T10:02:03.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
19302025-02-21T10:02:03.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19312025-02-21T10:02:03.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19322025-02-21T10:02:03.584ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
19332025-02-21T10:02:03.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.654845ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
19342025-02-21T10:02:03.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.167436ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19352025-02-21T10:02:03.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 577ead31-3da0-43d5-bd5f-5e7b3a2a2a51 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19362025-02-21T10:02:03.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 577ead31-3da0-43d5-bd5f-5e7b3a2a2a51 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19372025-02-21T10:02:03.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 577ead31-3da0-43d5-bd5f-5e7b3a2a2a51 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19382025-02-21T10:02:04.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = aa218805-21cf-4d73-abdc-7df47fe2149c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19392025-02-21T10:02:04.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = aa218805-21cf-4d73-abdc-7df47fe2149c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19402025-02-21T10:02:04.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = aa218805-21cf-4d73-abdc-7df47fe2149c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19412025-02-21T10:02:06.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f38481e3-6ece-483a-b3d2-0eb94036bf48 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19422025-02-21T10:02:06.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f38481e3-6ece-483a-b3d2-0eb94036bf48 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19432025-02-21T10:02:06.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f38481e3-6ece-483a-b3d2-0eb94036bf48 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19442025-02-21T10:02:06.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 210bcf92-9343-4c01-b5e6-89a31ff70cb9 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
19452025-02-21T10:02:06.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 210bcf92-9343-4c01-b5e6-89a31ff70cb9 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
19462025-02-21T10:02:06.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2742 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 210bcf92-9343-4c01-b5e6-89a31ff70cb9 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
19472025-02-21T10:02:06.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 5a4f7832-1616-4bb3-96b8-f6e5ba6b32a7 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
19482025-02-21T10:02:06.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 5a4f7832-1616-4bb3-96b8-f6e5ba6b32a7 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
19492025-02-21T10:02:06.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2527 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 5a4f7832-1616-4bb3-96b8-f6e5ba6b32a7 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
19502025-02-21T10:02:06.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 547 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 3498a0e6-f3bf-4164-8dc1-ebdec20ec8ca response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
19512025-02-21T10:02:07.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1cb82392-7a0f-44a0-8282-41b9a863ac98 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19522025-02-21T10:02:07.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1cb82392-7a0f-44a0-8282-41b9a863ac98 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19532025-02-21T10:02:07.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1871 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1cb82392-7a0f-44a0-8282-41b9a863ac98 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19542025-02-21T10:02:08.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6736976f-25bf-468e-aa77-73744f56b03a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19552025-02-21T10:02:08.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6736976f-25bf-468e-aa77-73744f56b03a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19562025-02-21T10:02:08.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2656 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6736976f-25bf-468e-aa77-73744f56b03a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19572025-02-21T10:02:09.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 04ffc485-cd94-4b3c-85dc-b77226cf4eb8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19582025-02-21T10:02:09.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 04ffc485-cd94-4b3c-85dc-b77226cf4eb8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19592025-02-21T10:02:09.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2663 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 04ffc485-cd94-4b3c-85dc-b77226cf4eb8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19602025-02-21T10:02:10.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03b619c6-bec9-464c-9e25-c4d3fc142397 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19612025-02-21T10:02:10.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03b619c6-bec9-464c-9e25-c4d3fc142397 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19622025-02-21T10:02:10.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3032 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03b619c6-bec9-464c-9e25-c4d3fc142397 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19632025-02-21T10:02:11.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = de7d7d2e-4b6d-4969-9356-0122bd2c7524 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19642025-02-21T10:02:11.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = de7d7d2e-4b6d-4969-9356-0122bd2c7524 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19652025-02-21T10:02:11.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = de7d7d2e-4b6d-4969-9356-0122bd2c7524 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19662025-02-21T10:02:12.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7a8e612b-abb4-46d3-8950-91e1a43f902d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19672025-02-21T10:02:12.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7a8e612b-abb4-46d3-8950-91e1a43f902d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19682025-02-21T10:02:12.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7a8e612b-abb4-46d3-8950-91e1a43f902d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19692025-02-21T10:02:13.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 89a0fb50-b559-461b-a418-0d9ea68b90b5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19702025-02-21T10:02:13.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 89a0fb50-b559-461b-a418-0d9ea68b90b5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19712025-02-21T10:02:13.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2542 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 89a0fb50-b559-461b-a418-0d9ea68b90b5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19722025-02-21T10:02:13.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
19732025-02-21T10:02:13.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19742025-02-21T10:02:13.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
19752025-02-21T10:02:13.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19762025-02-21T10:02:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19772025-02-21T10:02:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19782025-02-21T10:02:13.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19792025-02-21T10:02:13.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19802025-02-21T10:02:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19812025-02-21T10:02:13.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.555305ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19822025-02-21T10:02:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19832025-02-21T10:02:13.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19842025-02-21T10:02:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19852025-02-21T10:02:13.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19862025-02-21T10:02:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19872025-02-21T10:02:13.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19882025-02-21T10:02:13.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
19892025-02-21T10:02:13.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19902025-02-21T10:02:13.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19912025-02-21T10:02:13.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
19922025-02-21T10:02:13.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.701622ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
19932025-02-21T10:02:14.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c5752af4-fc12-4f7d-97f2-2f77d74d35cf roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19942025-02-21T10:02:14.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c5752af4-fc12-4f7d-97f2-2f77d74d35cf resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19952025-02-21T10:02:14.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c5752af4-fc12-4f7d-97f2-2f77d74d35cf response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19962025-02-21T10:02:15.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7a23439-c205-4629-b87a-5bb15161fa65 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19972025-02-21T10:02:15.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7a23439-c205-4629-b87a-5bb15161fa65 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19982025-02-21T10:02:15.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7a23439-c205-4629-b87a-5bb15161fa65 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
19992025-02-21T10:02:16.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2a16048c-9b1e-4f68-9a1a-1a47fe23130e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20002025-02-21T10:02:16.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2a16048c-9b1e-4f68-9a1a-1a47fe23130e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20012025-02-21T10:02:16.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1777 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2a16048c-9b1e-4f68-9a1a-1a47fe23130e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20022025-02-21T10:02:16.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1026 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 3d421e44-9774-4366-99b6-f96840a08c9a response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
20032025-02-21T10:02:17.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c11c62e7-d68d-4444-a2fd-b5db8f5a6553 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20042025-02-21T10:02:17.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c11c62e7-d68d-4444-a2fd-b5db8f5a6553 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20052025-02-21T10:02:17.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c11c62e7-d68d-4444-a2fd-b5db8f5a6553 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20062025-02-21T10:02:18.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49ffb9c4-943e-45dc-b110-4e781e3abf72 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20072025-02-21T10:02:18.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49ffb9c4-943e-45dc-b110-4e781e3abf72 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20082025-02-21T10:02:18.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49ffb9c4-943e-45dc-b110-4e781e3abf72 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20092025-02-21T10:02:19.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4d0a0e9d-9ec1-4fee-87d8-54abcf12e025 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20102025-02-21T10:02:19.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4d0a0e9d-9ec1-4fee-87d8-54abcf12e025 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20112025-02-21T10:02:19.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4d0a0e9d-9ec1-4fee-87d8-54abcf12e025 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20122025-02-21T10:02:20.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bbbf047b-9877-483e-b6ae-6bcd20618a4d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20132025-02-21T10:02:20.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bbbf047b-9877-483e-b6ae-6bcd20618a4d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20142025-02-21T10:02:20.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bbbf047b-9877-483e-b6ae-6bcd20618a4d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20152025-02-21T10:02:21.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4a28ab15-537a-41f2-84e1-8f2456643de7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20162025-02-21T10:02:21.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4a28ab15-537a-41f2-84e1-8f2456643de7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20172025-02-21T10:02:21.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4a28ab15-537a-41f2-84e1-8f2456643de7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20182025-02-21T10:02:22.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8096f76c-652f-4d24-a995-81daa85dc42c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20192025-02-21T10:02:22.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8096f76c-652f-4d24-a995-81daa85dc42c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20202025-02-21T10:02:22.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8096f76c-652f-4d24-a995-81daa85dc42c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20212025-02-21T10:02:23.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 04afc899-7e7d-416c-9cbd-c9fa0e24c063 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
20222025-02-21T10:02:23.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 04afc899-7e7d-416c-9cbd-c9fa0e24c063 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
20232025-02-21T10:02:23.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4055 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 04afc899-7e7d-416c-9cbd-c9fa0e24c063 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
20242025-02-21T10:02:23.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 79f4e5c5-2102-4225-a3cc-6f134c3f3ef9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20252025-02-21T10:02:23.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 79f4e5c5-2102-4225-a3cc-6f134c3f3ef9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20262025-02-21T10:02:23.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 79f4e5c5-2102-4225-a3cc-6f134c3f3ef9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
20272025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
20282025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20292025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
20302025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
20312025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20322025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
20332025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
20342025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20352025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
20362025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20372025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20382025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
20392025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
20402025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20412025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20422025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
20432025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
20442025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
20452025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20462025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
20472025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20482025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
20492025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
20502025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
20512025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20522025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
20532025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20542025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
20552025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20562025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
20572025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20582025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
20592025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
20602025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
20612025-02-21T10:02:23.559ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
20622025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20632025-02-21T10:02:23.560ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20642025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20652025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
20662025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
20672025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20682025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20692025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 9 reason = Timeout
20702025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
20712025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
20722025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
20732025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
20742025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20752025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20762025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20772025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
20782025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
20792025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20802025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
20812025-02-21T10:02:23.560ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041
20822025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.471\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041"}
20832025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
20842025-02-21T10:02:23.560ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
20852025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
20862025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20872025-02-21T10:02:23.560ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-21 09:52:23.560109544 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
20882025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
20892025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
20902025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
20912025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20922025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
20932025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20942025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20952025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20962025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20972025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20982025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20992025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21002025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21012025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21022025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
21032025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
21042025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21052025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21062025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21072025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21082025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
21092025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21102025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21112025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21122025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21132025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
21142025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21152025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21162025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21172025-02-21T10:02:23.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d154e9e-6d90-4040-b311-004f0e299e85.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e63432d-4205-48df-bd2b-03a054e87ab0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1341, tv_nsec: 857174401 } })
21182025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21192025-02-21T10:02:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
21202025-02-21T10:02:23.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3bf841e1-42b9-4bd7-ac20-7644b8a83464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1341, tv_nsec: 857209312 } })
21212025-02-21T10:02:23.561ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
21222025-02-21T10:02:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.067785ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
21232025-02-21T10:02:23.561ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
21242025-02-21T10:02:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.486116ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
21252025-02-21T10:02:23.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21262025-02-21T10:02:23.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21272025-02-21T10:02:23.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21282025-02-21T10:02:23.564ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.219901ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
21292025-02-21T10:02:23.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21302025-02-21T10:02:23.564ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1341, tv_nsec: 861017664 } })
21312025-02-21T10:02:23.564ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
21322025-02-21T10:02:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21332025-02-21T10:02:23.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21342025-02-21T10:02:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21352025-02-21T10:02:23.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21362025-02-21T10:02:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21372025-02-21T10:02:23.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21382025-02-21T10:02:23.565ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21392025-02-21T10:02:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21402025-02-21T10:02:23.567ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1341, tv_nsec: 863960305 } })
21412025-02-21T10:02:23.567ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
21422025-02-21T10:02:23.568ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21432025-02-21T10:02:23.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21442025-02-21T10:02:23.569ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
21452025-02-21T10:02:23.569ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
21462025-02-21T10:02:23.569ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.017321ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
21472025-02-21T10:02:23.571ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.477187ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
21482025-02-21T10:02:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21492025-02-21T10:02:23.571ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21502025-02-21T10:02:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21512025-02-21T10:02:23.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21522025-02-21T10:02:23.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21532025-02-21T10:02:23.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21542025-02-21T10:02:23.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21552025-02-21T10:02:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21562025-02-21T10:02:23.575ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21572025-02-21T10:02:23.576ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-21 09:52:23.560109544 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
21582025-02-21T10:02:23.576ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.917604ms iteration = 5 status = {"expiration":"2025-02-21T09:52:23.560109544Z","pruned":[]}
21592025-02-21T10:02:23.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21602025-02-21T10:02:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21612025-02-21T10:02:23.576ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21622025-02-21T10:02:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21632025-02-21T10:02:23.577ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21642025-02-21T10:02:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21652025-02-21T10:02:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
21662025-02-21T10:02:23.579ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21672025-02-21T10:02:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21682025-02-21T10:02:23.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21692025-02-21T10:02:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21702025-02-21T10:02:23.583ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21712025-02-21T10:02:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21722025-02-21T10:02:23.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21732025-02-21T10:02:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21742025-02-21T10:02:23.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21752025-02-21T10:02:23.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21762025-02-21T10:02:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21772025-02-21T10:02:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21782025-02-21T10:02:23.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21792025-02-21T10:02:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21802025-02-21T10:02:23.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21812025-02-21T10:02:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21822025-02-21T10:02:23.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21832025-02-21T10:02:23.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.470721ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
21842025-02-21T10:02:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
21852025-02-21T10:02:23.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21862025-02-21T10:02:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21872025-02-21T10:02:23.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21882025-02-21T10:02:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
21892025-02-21T10:02:23.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21902025-02-21T10:02:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21912025-02-21T10:02:23.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21922025-02-21T10:02:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21932025-02-21T10:02:23.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.085441ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
21942025-02-21T10:02:23.614ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21952025-02-21T10:02:23.614ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21962025-02-21T10:02:23.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21972025-02-21T10:02:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21982025-02-21T10:02:23.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21992025-02-21T10:02:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22002025-02-21T10:02:23.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22012025-02-21T10:02:23.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22022025-02-21T10:02:23.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22032025-02-21T10:02:23.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22042025-02-21T10:02:23.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22052025-02-21T10:02:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22062025-02-21T10:02:23.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22072025-02-21T10:02:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22082025-02-21T10:02:23.622ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22092025-02-21T10:02:23.622ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22102025-02-21T10:02:23.622ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22112025-02-21T10:02:23.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22122025-02-21T10:02:23.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22132025-02-21T10:02:23.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22142025-02-21T10:02:23.625ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 65.924351ms iteration = 9 status = {"errors":[],"requests_created_ok":[]}
22152025-02-21T10:02:23.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22162025-02-21T10:02:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22172025-02-21T10:02:23.626ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22182025-02-21T10:02:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22192025-02-21T10:02:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22202025-02-21T10:02:23.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22212025-02-21T10:02:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22222025-02-21T10:02:23.627ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22232025-02-21T10:02:23.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22242025-02-21T10:02:23.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22252025-02-21T10:02:23.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.932043ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22262025-02-21T10:02:23.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22272025-02-21T10:02:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22282025-02-21T10:02:23.633ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22292025-02-21T10:02:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22302025-02-21T10:02:23.633ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1341, tv_nsec: 930012049 } })
22312025-02-21T10:02:23.633ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
22322025-02-21T10:02:23.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.113853ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22332025-02-21T10:02:23.638ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
22342025-02-21T10:02:23.638ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.531546ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
22352025-02-21T10:02:23.643ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
22362025-02-21T10:02:23.643ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.2836ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
22372025-02-21T10:02:23.645ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
22382025-02-21T10:02:23.645ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
22392025-02-21T10:02:23.645ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
22402025-02-21T10:02:23.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22412025-02-21T10:02:23.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22422025-02-21T10:02:23.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22432025-02-21T10:02:23.647ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
22442025-02-21T10:02:23.647ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
22452025-02-21T10:02:23.647ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
22462025-02-21T10:02:23.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22472025-02-21T10:02:23.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22482025-02-21T10:02:23.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22492025-02-21T10:02:23.648ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22502025-02-21T10:02:23.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22512025-02-21T10:02:23.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22522025-02-21T10:02:23.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22532025-02-21T10:02:23.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22542025-02-21T10:02:23.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22552025-02-21T10:02:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22562025-02-21T10:02:23.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22572025-02-21T10:02:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22582025-02-21T10:02:23.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22592025-02-21T10:02:23.653ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22602025-02-21T10:02:23.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22612025-02-21T10:02:23.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22622025-02-21T10:02:23.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22632025-02-21T10:02:23.654ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
22642025-02-21T10:02:23.654ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 0 version = 2
22652025-02-21T10:02:23.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22662025-02-21T10:02:23.654ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
22672025-02-21T10:02:23.654ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
22682025-02-21T10:02:23.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22692025-02-21T10:02:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22702025-02-21T10:02:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22712025-02-21T10:02:23.655ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22722025-02-21T10:02:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22732025-02-21T10:02:23.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22742025-02-21T10:02:23.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22752025-02-21T10:02:23.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22762025-02-21T10:02:23.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22772025-02-21T10:02:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22782025-02-21T10:02:23.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22792025-02-21T10:02:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22802025-02-21T10:02:23.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.450413ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
22812025-02-21T10:02:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
22822025-02-21T10:02:23.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22832025-02-21T10:02:23.662ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 1 version = 2
22842025-02-21T10:02:23.662ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
22852025-02-21T10:02:23.662ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-21 09:58:29.727106 UTC dns_group = external generation = 2
22862025-02-21T10:02:23.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.804331ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22872025-02-21T10:02:23.662ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 102.567005ms iteration = 5 status = {"generation":2}
22882025-02-21T10:02:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22892025-02-21T10:02:23.665ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22902025-02-21T10:02:23.665ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22912025-02-21T10:02:23.665ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.492026ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22922025-02-21T10:02:23.665ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.766883ms iteration = 9 status = 0
22932025-02-21T10:02:23.665ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22942025-02-21T10:02:23.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22952025-02-21T10:02:23.668ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22962025-02-21T10:02:23.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22972025-02-21T10:02:23.677ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
22982025-02-21T10:02:23.683ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
22992025-02-21T10:02:23.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
23002025-02-21T10:02:23.692ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23012025-02-21T10:02:23.693ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62dc36a4-1bec-45e1-8b59-1108484a1d7a", "content-length": "26", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
23022025-02-21T10:02:23.693ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23032025-02-21T10:02:23.695ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23042025-02-21T10:02:23.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23052025-02-21T10:02:23.700ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-21T09:58:18.895783Z, time_modified: 2025-02-21T09:58:18.895783Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }) }
23062025-02-21T10:02:23.700ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 140.601193ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]}},"default_endpoint":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
23072025-02-21T10:02:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23082025-02-21T10:02:23.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23092025-02-21T10:02:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23102025-02-21T10:02:23.707ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
23112025-02-21T10:02:23.707ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 147.019509ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
23122025-02-21T10:02:23.708ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
23132025-02-21T10:02:23.708ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23142025-02-21T10:02:23.708ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a8c7173-c40b-4ef2-93bf-05f01a3034b7", "content-length": "26", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
23152025-02-21T10:02:23.708ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23162025-02-21T10:02:23.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23172025-02-21T10:02:23.728ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.366134ms iteration = 11 status = {"physical_disks_added":0}
23182025-02-21T10:02:23.730ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
23192025-02-21T10:02:23.730ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 170.741431ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
23202025-02-21T10:02:23.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23212025-02-21T10:02:23.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23222025-02-21T10:02:23.752ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23232025-02-21T10:02:23.752ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23242025-02-21T10:02:23.752ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 192.493097ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23252025-02-21T10:02:23.857ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23262025-02-21T10:02:23.863ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
23272025-02-21T10:02:23.864ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3f3699e0-5d3c-4a2e-b7a7-e2834440905a", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23282025-02-21T10:02:23.864ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23292025-02-21T10:02:23.865ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "37137ff7-9529-448d-9160-e71fee8caf00", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23302025-02-21T10:02:23.865ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23312025-02-21T10:02:23.867ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23322025-02-21T10:02:23.867ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 307.049102ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23332025-02-21T10:02:23.873ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23342025-02-21T10:02:23.873ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23352025-02-21T10:02:23.874ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "98a96114-8d17-4c68-8ea5-327ce8e74f75", "content-length": "372", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
23362025-02-21T10:02:23.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23372025-02-21T10:02:23.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23382025-02-21T10:02:23.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23392025-02-21T10:02:23.876ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
23402025-02-21T10:02:23.876ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23412025-02-21T10:02:23.876ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-21 09:58:29.164998 UTC dns_group = internal generation = 1
23422025-02-21T10:02:23.876ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 316.564302ms iteration = 5 status = {"generation":1}
23432025-02-21T10:02:23.877ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
23442025-02-21T10:02:23.877ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23452025-02-21T10:02:23.877ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "04bcccc3-d4c7-49bb-887c-36b18566b48a", "content-length": "26", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
23462025-02-21T10:02:23.877ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23472025-02-21T10:02:23.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23482025-02-21T10:02:23.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23492025-02-21T10:02:23.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23502025-02-21T10:02:23.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23512025-02-21T10:02:23.879ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
23522025-02-21T10:02:23.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23532025-02-21T10:02:23.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23542025-02-21T10:02:23.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23552025-02-21T10:02:23.881ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 321.239645ms iteration = 9 status = {}
23562025-02-21T10:02:23.918ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
23572025-02-21T10:02:23.918ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23582025-02-21T10:02:23.918ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "402717e2-f276-4fc9-82d4-18be7cf6efc2", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
23592025-02-21T10:02:23.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23602025-02-21T10:02:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23612025-02-21T10:02:23.920ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23622025-02-21T10:02:23.920ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d0ebef4-da3e-438b-9069-d12392fbfe5f", "content-length": "1", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
23632025-02-21T10:02:23.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23642025-02-21T10:02:23.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23652025-02-21T10:02:23.922ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23662025-02-21T10:02:23.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23672025-02-21T10:02:23.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23682025-02-21T10:02:23.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23692025-02-21T10:02:23.924ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 364.798277ms iteration = 9 status = null
23702025-02-21T10:02:23.926ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23712025-02-21T10:02:23.926ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23722025-02-21T10:02:23.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b71102de-cd6d-4a0d-b269-d99a09065a6e", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
23732025-02-21T10:02:23.929ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 369.412257ms iteration = 9 status = {}
23742025-02-21T10:02:23.964ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23752025-02-21T10:02:23.965ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e6dca1ec-dce8-4138-bdda-5d23a2701f9a", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23762025-02-21T10:02:23.965ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23772025-02-21T10:02:23.966ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a6a59d6d-4749-489d-bd7d-17e2165454f2", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23782025-02-21T10:02:23.967ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23792025-02-21T10:02:23.969ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "adbb6daf-19d4-4650-a58e-7fc8eddb247b", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23802025-02-21T10:02:23.969ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23812025-02-21T10:02:23.970ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23822025-02-21T10:02:23.970ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 411.084773ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
23832025-02-21T10:02:23.976ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23842025-02-21T10:02:23.976ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8ddf25c-03c0-4e68-964b-01f561dd33df", "content-length": "691", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
23852025-02-21T10:02:23.976ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23862025-02-21T10:02:23.976ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23872025-02-21T10:02:23.976ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23882025-02-21T10:02:23.977ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 417.891288ms iteration = 9 status = {}
23892025-02-21T10:02:24.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23902025-02-21T10:02:24.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23912025-02-21T10:02:24.036ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
23922025-02-21T10:02:24.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23932025-02-21T10:02:24.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23942025-02-21T10:02:24.046ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23952025-02-21T10:02:24.046ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6581a0f3-f556-45a5-81df-89e81a43163c", "content-length": "134", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
23962025-02-21T10:02:24.046ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
23972025-02-21T10:02:24.046ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
23982025-02-21T10:02:24.046ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
23992025-02-21T10:02:24.046ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24002025-02-21T10:02:24.046ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24012025-02-21T10:02:24.046ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24022025-02-21T10:02:24.046ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24032025-02-21T10:02:24.046ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24042025-02-21T10:02:24.047ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24052025-02-21T10:02:24.047ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24062025-02-21T10:02:24.047ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
24072025-02-21T10:02:24.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24082025-02-21T10:02:24.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24092025-02-21T10:02:24.049ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24102025-02-21T10:02:24.049ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "46d42af3-357b-4338-8166-dfff972a0e87", "content-length": "2", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
24112025-02-21T10:02:24.049ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24122025-02-21T10:02:24.049ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "de15111c-4cc8-4340-9b34-ae8208d9b09e", "content-length": "52", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
24132025-02-21T10:02:24.049ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
24142025-02-21T10:02:24.049ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24152025-02-21T10:02:24.149ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "74d1f7ff-53d2-46b4-8a5e-f0cd855a79f7", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
24162025-02-21T10:02:24.149ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
24172025-02-21T10:02:24.149ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24182025-02-21T10:02:24.149ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ada22254-e3d1-4b91-8a7d-8e4ff3566f1a", "content-length": "682", "date": "Fri, 21 Feb 2025 10:02:23 GMT"} })
24192025-02-21T10:02:24.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24202025-02-21T10:02:24.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24212025-02-21T10:02:24.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24222025-02-21T10:02:24.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24232025-02-21T10:02:24.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24242025-02-21T10:02:24.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24252025-02-21T10:02:24.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24262025-02-21T10:02:24.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24272025-02-21T10:02:24.165ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 605.482517ms iteration = 9 status = {}
24282025-02-21T10:02:24.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d49e15cd-971e-46d8-b4ea-3c062e691f8c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24292025-02-21T10:02:24.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d49e15cd-971e-46d8-b4ea-3c062e691f8c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24302025-02-21T10:02:24.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1622 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d49e15cd-971e-46d8-b4ea-3c062e691f8c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24312025-02-21T10:02:25.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8329e2e2-e65d-46d1-8d73-a5d3bc97a453 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24322025-02-21T10:02:25.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8329e2e2-e65d-46d1-8d73-a5d3bc97a453 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24332025-02-21T10:02:25.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8329e2e2-e65d-46d1-8d73-a5d3bc97a453 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24342025-02-21T10:02:26.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 587e99bd-a1e4-4269-9332-b5a57eb8cdef roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24352025-02-21T10:02:26.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 587e99bd-a1e4-4269-9332-b5a57eb8cdef resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24362025-02-21T10:02:26.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2024 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 587e99bd-a1e4-4269-9332-b5a57eb8cdef response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24372025-02-21T10:02:26.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 491 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 6a5d95ff-9805-46a4-895a-1f1b02b0c9c9 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
24382025-02-21T10:02:27.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4d412d8c-2a50-4648-9c74-0c614669da80 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24392025-02-21T10:02:27.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4d412d8c-2a50-4648-9c74-0c614669da80 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24402025-02-21T10:02:27.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2673 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4d412d8c-2a50-4648-9c74-0c614669da80 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24412025-02-21T10:02:28.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 31906ae7-34b5-437a-941d-95ccc548f0b5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24422025-02-21T10:02:28.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 31906ae7-34b5-437a-941d-95ccc548f0b5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24432025-02-21T10:02:28.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2643 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 31906ae7-34b5-437a-941d-95ccc548f0b5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24442025-02-21T10:02:29.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1eb0f55f-9bad-4a45-a839-87fd78898cb6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24452025-02-21T10:02:29.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1eb0f55f-9bad-4a45-a839-87fd78898cb6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24462025-02-21T10:02:29.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1eb0f55f-9bad-4a45-a839-87fd78898cb6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24472025-02-21T10:02:30.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ea4ccbc2-872c-424f-b1dd-2ccfe5876f3b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24482025-02-21T10:02:30.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ea4ccbc2-872c-424f-b1dd-2ccfe5876f3b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24492025-02-21T10:02:30.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2794 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ea4ccbc2-872c-424f-b1dd-2ccfe5876f3b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24502025-02-21T10:02:31.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d9461120-e198-4b46-a6ca-5e4ea0ac3e7d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24512025-02-21T10:02:31.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d9461120-e198-4b46-a6ca-5e4ea0ac3e7d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24522025-02-21T10:02:31.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d9461120-e198-4b46-a6ca-5e4ea0ac3e7d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24532025-02-21T10:02:32.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0c865bc6-61f1-4a68-84c1-5b2da56e2c97 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24542025-02-21T10:02:32.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0c865bc6-61f1-4a68-84c1-5b2da56e2c97 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24552025-02-21T10:02:32.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2099 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0c865bc6-61f1-4a68-84c1-5b2da56e2c97 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24562025-02-21T10:02:33.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
24572025-02-21T10:02:33.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24582025-02-21T10:02:33.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
24592025-02-21T10:02:33.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24602025-02-21T10:02:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24612025-02-21T10:02:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24622025-02-21T10:02:33.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24632025-02-21T10:02:33.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24642025-02-21T10:02:33.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24652025-02-21T10:02:33.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.224322ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24662025-02-21T10:02:33.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24672025-02-21T10:02:33.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24682025-02-21T10:02:33.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24692025-02-21T10:02:33.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24702025-02-21T10:02:33.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24712025-02-21T10:02:33.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24722025-02-21T10:02:33.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
24732025-02-21T10:02:33.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24742025-02-21T10:02:33.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24752025-02-21T10:02:33.579ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
24762025-02-21T10:02:33.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.405601ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
24772025-02-21T10:02:33.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eef11c5a-817f-41b5-9ef2-f59c0415338b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24782025-02-21T10:02:33.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eef11c5a-817f-41b5-9ef2-f59c0415338b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24792025-02-21T10:02:33.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1319 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eef11c5a-817f-41b5-9ef2-f59c0415338b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24802025-02-21T10:02:34.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0fe53c22-f2e0-4309-8208-c9a67c8713a3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24812025-02-21T10:02:34.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0fe53c22-f2e0-4309-8208-c9a67c8713a3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24822025-02-21T10:02:34.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2501 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0fe53c22-f2e0-4309-8208-c9a67c8713a3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24832025-02-21T10:02:35.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c024cc49-50f6-4bff-85c9-63a9a405ced9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24842025-02-21T10:02:35.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c024cc49-50f6-4bff-85c9-63a9a405ced9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24852025-02-21T10:02:35.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c024cc49-50f6-4bff-85c9-63a9a405ced9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24862025-02-21T10:02:36.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 581 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 3d5d01c9-eac3-40a3-907e-3db525324e4a response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
24872025-02-21T10:02:36.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7dda6c63-2248-4740-8427-2c9c3ba05825 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24882025-02-21T10:02:36.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7dda6c63-2248-4740-8427-2c9c3ba05825 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24892025-02-21T10:02:36.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2629 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7dda6c63-2248-4740-8427-2c9c3ba05825 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24902025-02-21T10:02:37.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a256fbb9-2131-45ed-901d-cbc053c5c1aa roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24912025-02-21T10:02:37.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a256fbb9-2131-45ed-901d-cbc053c5c1aa resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24922025-02-21T10:02:37.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2704 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a256fbb9-2131-45ed-901d-cbc053c5c1aa response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24932025-02-21T10:02:38.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d5569b53-0a8f-401c-90d3-41009348908c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24942025-02-21T10:02:38.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d5569b53-0a8f-401c-90d3-41009348908c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24952025-02-21T10:02:38.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d5569b53-0a8f-401c-90d3-41009348908c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24962025-02-21T10:02:39.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e6dd5545-b700-4b01-94ef-1b8d0765623a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24972025-02-21T10:02:39.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e6dd5545-b700-4b01-94ef-1b8d0765623a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24982025-02-21T10:02:39.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e6dd5545-b700-4b01-94ef-1b8d0765623a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
24992025-02-21T10:02:40.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ef769f47-188a-4240-a66f-03bd2627c789 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25002025-02-21T10:02:40.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ef769f47-188a-4240-a66f-03bd2627c789 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25012025-02-21T10:02:40.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1907 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ef769f47-188a-4240-a66f-03bd2627c789 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25022025-02-21T10:02:41.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 16565cb8-7886-41c3-a3e3-08de075e342c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25032025-02-21T10:02:41.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 16565cb8-7886-41c3-a3e3-08de075e342c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25042025-02-21T10:02:41.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 16565cb8-7886-41c3-a3e3-08de075e342c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25052025-02-21T10:02:42.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 600e89fa-51da-4573-8124-e51946ec2088 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25062025-02-21T10:02:42.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 600e89fa-51da-4573-8124-e51946ec2088 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25072025-02-21T10:02:42.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 600e89fa-51da-4573-8124-e51946ec2088 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25082025-02-21T10:02:43.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
25092025-02-21T10:02:43.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25102025-02-21T10:02:43.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
25112025-02-21T10:02:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25122025-02-21T10:02:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25132025-02-21T10:02:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25142025-02-21T10:02:43.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25152025-02-21T10:02:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25162025-02-21T10:02:43.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25172025-02-21T10:02:43.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.872573ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25182025-02-21T10:02:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25192025-02-21T10:02:43.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25202025-02-21T10:02:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25212025-02-21T10:02:43.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25222025-02-21T10:02:43.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25232025-02-21T10:02:43.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25242025-02-21T10:02:43.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
25252025-02-21T10:02:43.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25262025-02-21T10:02:43.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25272025-02-21T10:02:43.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
25282025-02-21T10:02:43.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.816294ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
25292025-02-21T10:02:43.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d1e62e6d-9ed1-4178-88d5-98bf4060ac0f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25302025-02-21T10:02:43.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d1e62e6d-9ed1-4178-88d5-98bf4060ac0f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25312025-02-21T10:02:43.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1901 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d1e62e6d-9ed1-4178-88d5-98bf4060ac0f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25322025-02-21T10:02:44.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 209e39bb-cc12-44c9-9408-74cc9f97df57 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25332025-02-21T10:02:44.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 209e39bb-cc12-44c9-9408-74cc9f97df57 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25342025-02-21T10:02:44.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1894 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 209e39bb-cc12-44c9-9408-74cc9f97df57 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25352025-02-21T10:02:45.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b8194903-5ae8-41ba-9ceb-42f02ad13142 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25362025-02-21T10:02:45.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b8194903-5ae8-41ba-9ceb-42f02ad13142 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25372025-02-21T10:02:45.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b8194903-5ae8-41ba-9ceb-42f02ad13142 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25382025-02-21T10:02:46.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 478 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 86458074-4377-4f33-b7be-49e448aecd9b response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
25392025-02-21T10:02:46.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 21902efa-61f5-4210-807e-fbb248f8ccf8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25402025-02-21T10:02:46.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 21902efa-61f5-4210-807e-fbb248f8ccf8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25412025-02-21T10:02:46.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 21902efa-61f5-4210-807e-fbb248f8ccf8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25422025-02-21T10:02:47.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49773f99-ac77-43b2-ad3f-26d5875b5ce8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25432025-02-21T10:02:47.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49773f99-ac77-43b2-ad3f-26d5875b5ce8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25442025-02-21T10:02:47.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1550 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49773f99-ac77-43b2-ad3f-26d5875b5ce8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25452025-02-21T10:02:48.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c79dbc41-7327-466a-92e6-7925505668bc roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25462025-02-21T10:02:48.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c79dbc41-7327-466a-92e6-7925505668bc resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25472025-02-21T10:02:48.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2464 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c79dbc41-7327-466a-92e6-7925505668bc response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25482025-02-21T10:02:49.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9b0631c6-5853-412a-9dc9-259b16771dee roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25492025-02-21T10:02:49.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9b0631c6-5853-412a-9dc9-259b16771dee resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25502025-02-21T10:02:49.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9b0631c6-5853-412a-9dc9-259b16771dee response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25512025-02-21T10:02:50.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f35edb32-fc15-41c2-9dba-ed8c8d69dda6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25522025-02-21T10:02:50.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f35edb32-fc15-41c2-9dba-ed8c8d69dda6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25532025-02-21T10:02:50.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2378 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f35edb32-fc15-41c2-9dba-ed8c8d69dda6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25542025-02-21T10:02:51.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 5d5e407e-244a-4cdb-a87a-315ad3df241f roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
25552025-02-21T10:02:51.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 5d5e407e-244a-4cdb-a87a-315ad3df241f resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
25562025-02-21T10:02:51.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3574 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 5d5e407e-244a-4cdb-a87a-315ad3df241f response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
25572025-02-21T10:02:51.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 0e88e2fe-5b36-4825-a37a-4a96192910b2 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
25582025-02-21T10:02:51.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 0e88e2fe-5b36-4825-a37a-4a96192910b2 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
25592025-02-21T10:02:51.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2800 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 0e88e2fe-5b36-4825-a37a-4a96192910b2 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
25602025-02-21T10:02:52.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 69116fcf-1093-4916-8b53-11f92370f60d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25612025-02-21T10:02:52.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 69116fcf-1093-4916-8b53-11f92370f60d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25622025-02-21T10:02:52.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 69116fcf-1093-4916-8b53-11f92370f60d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25632025-02-21T10:02:53.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = b50d5ed3-201f-4ac8-98ef-733fcf19ca9c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
25642025-02-21T10:02:53.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = b50d5ed3-201f-4ac8-98ef-733fcf19ca9c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
25652025-02-21T10:02:53.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2760 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = b50d5ed3-201f-4ac8-98ef-733fcf19ca9c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
25662025-02-21T10:02:53.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6b73d157-6d9b-4b3f-8fe8-dcbb69aad19b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25672025-02-21T10:02:53.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6b73d157-6d9b-4b3f-8fe8-dcbb69aad19b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25682025-02-21T10:02:53.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6b73d157-6d9b-4b3f-8fe8-dcbb69aad19b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
25692025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
25702025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
25712025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25722025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25732025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
25742025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25752025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
25762025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25772025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 10 reason = Timeout
25782025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
25792025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
25802025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25812025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
25822025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25832025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
25842025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25852025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25862025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
25872025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
25882025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
25892025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25902025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
25912025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
25922025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25932025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
25942025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
25952025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25962025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
25972025-02-21T10:02:53.559ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
25982025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25992025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26002025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
26012025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
26022025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26032025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26042025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
26052025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
26062025-02-21T10:02:53.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26072025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26082025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26092025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26102025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26112025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26122025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26132025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26142025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26152025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26162025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26172025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26182025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26192025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
26202025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26212025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26222025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26232025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26242025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26252025-02-21T10:02:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26262025-02-21T10:02:53.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26272025-02-21T10:02:53.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26282025-02-21T10:02:53.563ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.175336ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26292025-02-21T10:02:53.564ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26302025-02-21T10:02:53.564ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26312025-02-21T10:02:53.564ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26322025-02-21T10:02:53.564ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26332025-02-21T10:02:53.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26342025-02-21T10:02:53.565ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26352025-02-21T10:02:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26362025-02-21T10:02:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26372025-02-21T10:02:53.566ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26382025-02-21T10:02:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26392025-02-21T10:02:53.567ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1371, tv_nsec: 863656637 } })
26402025-02-21T10:02:53.567ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1371, tv_nsec: 863705388 } })
26412025-02-21T10:02:53.567ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
26422025-02-21T10:02:53.567ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
26432025-02-21T10:02:53.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26442025-02-21T10:02:53.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26452025-02-21T10:02:53.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26462025-02-21T10:02:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26472025-02-21T10:02:53.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26482025-02-21T10:02:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26492025-02-21T10:02:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26502025-02-21T10:02:53.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26512025-02-21T10:02:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26522025-02-21T10:02:53.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26532025-02-21T10:02:53.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26542025-02-21T10:02:53.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26552025-02-21T10:02:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26562025-02-21T10:02:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26572025-02-21T10:02:53.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26582025-02-21T10:02:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26592025-02-21T10:02:53.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26602025-02-21T10:02:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26612025-02-21T10:02:53.586ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26622025-02-21T10:02:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26632025-02-21T10:02:53.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26642025-02-21T10:02:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26652025-02-21T10:02:53.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26662025-02-21T10:02:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26672025-02-21T10:02:53.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1371, tv_nsec: 892115074 } })
26682025-02-21T10:02:53.596ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
26692025-02-21T10:02:53.599ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26702025-02-21T10:02:53.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26712025-02-21T10:02:53.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26722025-02-21T10:02:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26732025-02-21T10:02:53.601ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26742025-02-21T10:02:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26752025-02-21T10:02:53.603ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
26762025-02-21T10:02:53.603ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 43.330725ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
26772025-02-21T10:02:53.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26782025-02-21T10:02:53.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26792025-02-21T10:02:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26802025-02-21T10:02:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
26812025-02-21T10:02:53.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26822025-02-21T10:02:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26832025-02-21T10:02:53.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26842025-02-21T10:02:53.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26852025-02-21T10:02:53.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26862025-02-21T10:02:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26872025-02-21T10:02:53.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26882025-02-21T10:02:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26892025-02-21T10:02:53.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26902025-02-21T10:02:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26912025-02-21T10:02:53.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26922025-02-21T10:02:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26932025-02-21T10:02:53.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.537658ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
26942025-02-21T10:02:53.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.207499ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
26952025-02-21T10:02:53.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
26962025-02-21T10:02:53.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.753453ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
26972025-02-21T10:02:53.620ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26982025-02-21T10:02:53.620ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26992025-02-21T10:02:53.620ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27002025-02-21T10:02:53.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27012025-02-21T10:02:53.621ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 61.959906ms iteration = 10 status = {"errors":[],"requests_created_ok":[]}
27022025-02-21T10:02:53.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27032025-02-21T10:02:53.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27042025-02-21T10:02:53.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27052025-02-21T10:02:53.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27062025-02-21T10:02:53.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.582113ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27072025-02-21T10:02:53.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.609712ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27082025-02-21T10:02:53.630ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27092025-02-21T10:02:53.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27102025-02-21T10:02:53.631ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27112025-02-21T10:02:53.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27122025-02-21T10:02:53.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27132025-02-21T10:02:53.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27142025-02-21T10:02:53.633ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27152025-02-21T10:02:53.633ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.685309ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27162025-02-21T10:02:53.635ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27172025-02-21T10:02:53.636ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27182025-02-21T10:02:53.636ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27192025-02-21T10:02:53.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27202025-02-21T10:02:53.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27212025-02-21T10:02:53.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27222025-02-21T10:02:53.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27232025-02-21T10:02:53.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27242025-02-21T10:02:53.642ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27252025-02-21T10:02:53.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27262025-02-21T10:02:53.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27272025-02-21T10:02:53.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.500244ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27282025-02-21T10:02:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
27292025-02-21T10:02:53.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27302025-02-21T10:02:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27312025-02-21T10:02:53.646ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.883337ms iteration = 12 status = {"physical_disks_added":0}
27322025-02-21T10:02:53.653ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27332025-02-21T10:02:53.653ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27342025-02-21T10:02:53.653ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 93.662751ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27352025-02-21T10:02:53.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27362025-02-21T10:02:53.655ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
27372025-02-21T10:02:53.655ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27382025-02-21T10:02:53.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27392025-02-21T10:02:53.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27402025-02-21T10:02:53.655ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cb9c5ce-ed52-498d-80d7-dc2fc785ce19", "content-length": "26", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
27412025-02-21T10:02:53.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27422025-02-21T10:02:53.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27432025-02-21T10:02:53.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27442025-02-21T10:02:53.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
27452025-02-21T10:02:53.660ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27462025-02-21T10:02:53.661ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6ce6dae-0ad7-4307-99a8-339cb5476163", "content-length": "26", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
27472025-02-21T10:02:53.661ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27482025-02-21T10:02:53.662ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27492025-02-21T10:02:53.694ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
27502025-02-21T10:02:53.694ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27512025-02-21T10:02:53.695ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4556d357-e433-48b3-891b-4f9c69cbacd9", "content-length": "26", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
27522025-02-21T10:02:53.695ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27532025-02-21T10:02:53.696ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
27542025-02-21T10:02:53.746ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27552025-02-21T10:02:53.746ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7655104f-a74a-404d-9005-377c60b8a84b", "content-length": "691", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
27562025-02-21T10:02:53.746ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
27572025-02-21T10:02:53.746ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
27582025-02-21T10:02:53.746ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
27592025-02-21T10:02:53.748ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 188.264314ms iteration = 10 status = {}
27602025-02-21T10:02:53.748ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 188.870579ms iteration = 10 status = 0
27612025-02-21T10:02:53.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 214.59735ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
27622025-02-21T10:02:53.795ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 236.222862ms iteration = 10 status = {}
27632025-02-21T10:02:53.832ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27642025-02-21T10:02:53.832ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "421aafb0-0a18-41bf-8a62-827c67036239", "content-length": "1", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
27652025-02-21T10:02:53.834ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27662025-02-21T10:02:53.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27672025-02-21T10:02:53.836ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 276.773251ms iteration = 10 status = null
27682025-02-21T10:02:53.862ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27692025-02-21T10:02:53.862ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27702025-02-21T10:02:53.864ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c9ec837-eb49-4fcd-bd31-8cfa16c98ffa", "content-length": "372", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
27712025-02-21T10:02:53.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27722025-02-21T10:02:53.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27732025-02-21T10:02:53.905ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
27742025-02-21T10:02:53.905ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27752025-02-21T10:02:53.905ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "34bb8926-2a2e-4a96-aac2-a371cfd49c20", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
27762025-02-21T10:02:53.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27772025-02-21T10:02:53.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27782025-02-21T10:02:53.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27792025-02-21T10:02:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27802025-02-21T10:02:53.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27812025-02-21T10:02:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27822025-02-21T10:02:53.914ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27832025-02-21T10:02:53.914ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27842025-02-21T10:02:53.914ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "010da454-089d-4584-a562-c5125dd3ec65", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
27852025-02-21T10:02:53.916ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 356.964237ms iteration = 10 status = {}
27862025-02-21T10:02:53.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27872025-02-21T10:02:53.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27882025-02-21T10:02:53.924ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
27892025-02-21T10:02:53.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27902025-02-21T10:02:53.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27912025-02-21T10:02:53.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27922025-02-21T10:02:53.932ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2602a519-b1c7-4e7c-8b5a-58a606b519b2", "content-length": "134", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
27932025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27942025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
27952025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27962025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27972025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27982025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27992025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28002025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28012025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28022025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28032025-02-21T10:02:53.932ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
28042025-02-21T10:02:53.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28052025-02-21T10:02:53.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28062025-02-21T10:02:53.934ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28072025-02-21T10:02:53.934ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b280fd50-f1d5-4407-acfb-fe36e862a2f1", "content-length": "2", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
28082025-02-21T10:02:53.934ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28092025-02-21T10:02:53.934ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "84261f48-a87a-477b-9175-1661785b12a7", "content-length": "52", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
28102025-02-21T10:02:53.934ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
28112025-02-21T10:02:53.934ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28122025-02-21T10:02:54.040ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d6b23cf9-23c9-4a3a-8387-9b1da2d28df5", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
28132025-02-21T10:02:54.040ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
28142025-02-21T10:02:54.040ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28152025-02-21T10:02:54.040ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bd041a3-614d-491d-82a2-66ddbd280c20", "content-length": "682", "date": "Fri, 21 Feb 2025 10:02:53 GMT"} })
28162025-02-21T10:02:54.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28172025-02-21T10:02:54.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28182025-02-21T10:02:54.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28192025-02-21T10:02:54.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28202025-02-21T10:02:54.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28212025-02-21T10:02:54.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28222025-02-21T10:02:54.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28232025-02-21T10:02:54.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28242025-02-21T10:02:54.055ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 495.171393ms iteration = 10 status = {}
28252025-02-21T10:02:54.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55d5ee02-bb46-4766-84d1-fff11b7cb1db roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28262025-02-21T10:02:54.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55d5ee02-bb46-4766-84d1-fff11b7cb1db resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28272025-02-21T10:02:54.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1901 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55d5ee02-bb46-4766-84d1-fff11b7cb1db response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28282025-02-21T10:02:55.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c8748ba4-95be-4111-b804-341a036c57f5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28292025-02-21T10:02:55.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c8748ba4-95be-4111-b804-341a036c57f5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28302025-02-21T10:02:55.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c8748ba4-95be-4111-b804-341a036c57f5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28312025-02-21T10:02:56.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 805df5c8-72d1-465d-98dd-ecb2fad76524 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28322025-02-21T10:02:56.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 805df5c8-72d1-465d-98dd-ecb2fad76524 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28332025-02-21T10:02:56.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2150 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 805df5c8-72d1-465d-98dd-ecb2fad76524 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28342025-02-21T10:02:56.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 796 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 01ac8fff-fb93-441f-a024-18bfbf22a457 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
28352025-02-21T10:02:57.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b3b45cee-b726-4777-8d30-05dc3fd31c4d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28362025-02-21T10:02:57.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b3b45cee-b726-4777-8d30-05dc3fd31c4d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28372025-02-21T10:02:57.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2745 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b3b45cee-b726-4777-8d30-05dc3fd31c4d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28382025-02-21T10:02:58.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f398c62a-ef07-4807-83c2-6f6014d25812 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28392025-02-21T10:02:58.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f398c62a-ef07-4807-83c2-6f6014d25812 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28402025-02-21T10:02:58.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1966 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f398c62a-ef07-4807-83c2-6f6014d25812 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28412025-02-21T10:02:59.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 70bec2ab-7c94-421a-b7a6-c5debd4f72dc roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28422025-02-21T10:02:59.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 70bec2ab-7c94-421a-b7a6-c5debd4f72dc resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28432025-02-21T10:02:59.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 70bec2ab-7c94-421a-b7a6-c5debd4f72dc response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28442025-02-21T10:03:00.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6113fa6f-c757-44a8-942a-84cb7b985372 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28452025-02-21T10:03:00.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6113fa6f-c757-44a8-942a-84cb7b985372 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28462025-02-21T10:03:00.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6113fa6f-c757-44a8-942a-84cb7b985372 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28472025-02-21T10:03:01.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4e427e22-4e6c-4fdc-af5e-1bdaee33ae62 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28482025-02-21T10:03:01.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4e427e22-4e6c-4fdc-af5e-1bdaee33ae62 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28492025-02-21T10:03:01.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4e427e22-4e6c-4fdc-af5e-1bdaee33ae62 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28502025-02-21T10:03:02.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1a283c92-989f-4b0e-bb31-72a64831b764 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28512025-02-21T10:03:02.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1a283c92-989f-4b0e-bb31-72a64831b764 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28522025-02-21T10:03:02.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2869 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1a283c92-989f-4b0e-bb31-72a64831b764 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28532025-02-21T10:03:03.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9d063b6d-78f8-4ff7-a923-ddee6a0ad21a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28542025-02-21T10:03:03.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9d063b6d-78f8-4ff7-a923-ddee6a0ad21a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28552025-02-21T10:03:03.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9d063b6d-78f8-4ff7-a923-ddee6a0ad21a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28562025-02-21T10:03:03.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
28572025-02-21T10:03:03.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
28582025-02-21T10:03:03.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28592025-02-21T10:03:03.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28602025-02-21T10:03:03.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28612025-02-21T10:03:03.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28622025-02-21T10:03:03.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28632025-02-21T10:03:03.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28642025-02-21T10:03:03.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28652025-02-21T10:03:03.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.304724ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28662025-02-21T10:03:03.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28672025-02-21T10:03:03.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28682025-02-21T10:03:03.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28692025-02-21T10:03:03.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28702025-02-21T10:03:03.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28712025-02-21T10:03:03.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28722025-02-21T10:03:03.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
28732025-02-21T10:03:03.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28742025-02-21T10:03:03.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28752025-02-21T10:03:03.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
28762025-02-21T10:03:03.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.904156ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
28772025-02-21T10:03:04.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1e573e4b-2f49-445b-895c-e631e27036a3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28782025-02-21T10:03:04.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1e573e4b-2f49-445b-895c-e631e27036a3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28792025-02-21T10:03:04.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3142 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1e573e4b-2f49-445b-895c-e631e27036a3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28802025-02-21T10:03:05.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7772f8dc-4d9c-48ab-8d44-7afaab12a7ae roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28812025-02-21T10:03:05.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7772f8dc-4d9c-48ab-8d44-7afaab12a7ae resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28822025-02-21T10:03:05.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7772f8dc-4d9c-48ab-8d44-7afaab12a7ae response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28832025-02-21T10:03:06.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5bc56e5d-9914-45e8-85a7-aec05cdba46f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28842025-02-21T10:03:06.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5bc56e5d-9914-45e8-85a7-aec05cdba46f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28852025-02-21T10:03:06.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5bc56e5d-9914-45e8-85a7-aec05cdba46f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28862025-02-21T10:03:06.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 514 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = c39d5ee4-15d2-4df0-94bf-381be467b6a4 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
28872025-02-21T10:03:07.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4faf4d2a-4ca9-4a42-b323-5855b6108c48 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28882025-02-21T10:03:07.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4faf4d2a-4ca9-4a42-b323-5855b6108c48 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28892025-02-21T10:03:07.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2656 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4faf4d2a-4ca9-4a42-b323-5855b6108c48 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28902025-02-21T10:03:08.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff6ca1ee-fa84-4955-9834-ce6c3c5b5780 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28912025-02-21T10:03:08.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff6ca1ee-fa84-4955-9834-ce6c3c5b5780 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28922025-02-21T10:03:08.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff6ca1ee-fa84-4955-9834-ce6c3c5b5780 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28932025-02-21T10:03:09.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 54d717f6-0853-4f70-bff4-8987dbac2afa roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28942025-02-21T10:03:09.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 54d717f6-0853-4f70-bff4-8987dbac2afa resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28952025-02-21T10:03:09.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 54d717f6-0853-4f70-bff4-8987dbac2afa response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28962025-02-21T10:03:10.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d1d0f6e8-cfb7-4604-abb6-bc48c935fc4e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28972025-02-21T10:03:10.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d1d0f6e8-cfb7-4604-abb6-bc48c935fc4e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28982025-02-21T10:03:10.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d1d0f6e8-cfb7-4604-abb6-bc48c935fc4e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
28992025-02-21T10:03:11.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb339888-df83-439b-b96d-78e6f9c96d5c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29002025-02-21T10:03:11.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb339888-df83-439b-b96d-78e6f9c96d5c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29012025-02-21T10:03:11.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb339888-df83-439b-b96d-78e6f9c96d5c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29022025-02-21T10:03:12.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 577db305-4c86-4cbf-a430-9904c7cc1d52 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29032025-02-21T10:03:12.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 577db305-4c86-4cbf-a430-9904c7cc1d52 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29042025-02-21T10:03:12.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2345 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 577db305-4c86-4cbf-a430-9904c7cc1d52 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29052025-02-21T10:03:13.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
29062025-02-21T10:03:13.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29072025-02-21T10:03:13.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
29082025-02-21T10:03:13.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29092025-02-21T10:03:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29102025-02-21T10:03:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29112025-02-21T10:03:13.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29122025-02-21T10:03:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29132025-02-21T10:03:13.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29142025-02-21T10:03:13.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.827792ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29152025-02-21T10:03:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29162025-02-21T10:03:13.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29172025-02-21T10:03:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29182025-02-21T10:03:13.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29192025-02-21T10:03:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29202025-02-21T10:03:13.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29212025-02-21T10:03:13.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
29222025-02-21T10:03:13.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29232025-02-21T10:03:13.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29242025-02-21T10:03:13.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d694818e-1731-490f-9e8c-a5ef9ba14296 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29252025-02-21T10:03:13.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d694818e-1731-490f-9e8c-a5ef9ba14296 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29262025-02-21T10:03:13.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d694818e-1731-490f-9e8c-a5ef9ba14296 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29272025-02-21T10:03:13.681ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
29282025-02-21T10:03:13.681ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.821601ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
29292025-02-21T10:03:14.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fa9b7437-4643-4307-b17e-33da0ec2cd6a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29302025-02-21T10:03:14.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fa9b7437-4643-4307-b17e-33da0ec2cd6a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29312025-02-21T10:03:14.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fa9b7437-4643-4307-b17e-33da0ec2cd6a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29322025-02-21T10:03:15.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f44ddc0f-3a3b-4b18-8674-cbd58617b877 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29332025-02-21T10:03:15.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f44ddc0f-3a3b-4b18-8674-cbd58617b877 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29342025-02-21T10:03:15.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1969 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f44ddc0f-3a3b-4b18-8674-cbd58617b877 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29352025-02-21T10:03:16.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 558 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 13dd363a-b4dc-4f2b-b7c9-697a4dadd8fe response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
29362025-02-21T10:03:16.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5a1f5fdd-c90f-4946-bd77-dd848cee1408 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29372025-02-21T10:03:16.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5a1f5fdd-c90f-4946-bd77-dd848cee1408 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29382025-02-21T10:03:16.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5a1f5fdd-c90f-4946-bd77-dd848cee1408 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29392025-02-21T10:03:17.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7a0d685e-dfd0-41ec-9f53-58ae7aac1268 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29402025-02-21T10:03:17.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7a0d685e-dfd0-41ec-9f53-58ae7aac1268 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29412025-02-21T10:03:17.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7a0d685e-dfd0-41ec-9f53-58ae7aac1268 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29422025-02-21T10:03:18.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fd978009-31be-4101-9323-e40ffbc2f3a2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29432025-02-21T10:03:18.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fd978009-31be-4101-9323-e40ffbc2f3a2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29442025-02-21T10:03:18.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fd978009-31be-4101-9323-e40ffbc2f3a2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29452025-02-21T10:03:19.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f3b0e735-db61-4398-bfa6-01764f79e7f4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29462025-02-21T10:03:19.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f3b0e735-db61-4398-bfa6-01764f79e7f4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29472025-02-21T10:03:19.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f3b0e735-db61-4398-bfa6-01764f79e7f4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29482025-02-21T10:03:20.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 38173cc9-8f34-4dd8-bcc0-fa8b0160b52a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29492025-02-21T10:03:20.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 38173cc9-8f34-4dd8-bcc0-fa8b0160b52a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29502025-02-21T10:03:20.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 38173cc9-8f34-4dd8-bcc0-fa8b0160b52a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29512025-02-21T10:03:21.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 269df65b-3a26-4997-8549-567b9ea800fe roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29522025-02-21T10:03:21.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 269df65b-3a26-4997-8549-567b9ea800fe resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29532025-02-21T10:03:21.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2680 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 269df65b-3a26-4997-8549-567b9ea800fe response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29542025-02-21T10:03:22.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 68170857-ab14-490a-a7cb-c789a5e37948 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29552025-02-21T10:03:22.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 68170857-ab14-490a-a7cb-c789a5e37948 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29562025-02-21T10:03:22.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 68170857-ab14-490a-a7cb-c789a5e37948 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
29572025-02-21T10:03:23.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 1effd4bc-9424-432e-92e7-b9cd225e5505 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
29582025-02-21T10:03:23.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 1effd4bc-9424-432e-92e7-b9cd225e5505 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
29592025-02-21T10:03:23.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3409 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 1effd4bc-9424-432e-92e7-b9cd225e5505 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
29602025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
29612025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
29622025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29632025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29642025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
29652025-02-21T10:03:23.559ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
29662025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
29672025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29682025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29692025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
29702025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
29712025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29722025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
29732025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
29742025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29752025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
29762025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29772025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
29782025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 2 reason = Timeout
29792025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
29802025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29812025-02-21T10:03:23.559ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041
29822025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
29832025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.06\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041"}
29842025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
29852025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
29862025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29872025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
29882025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29892025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
29902025-02-21T10:03:23.559ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
29912025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29922025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
29932025-02-21T10:03:23.559ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-21 09:53:23.559548287 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
29942025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
29952025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
29962025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29972025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
29982025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 11 reason = Timeout
29992025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
30002025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
30012025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30022025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30032025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
30042025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30052025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
30062025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30072025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
30082025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
30092025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30102025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30112025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
30122025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30132025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30142025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
30152025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
30162025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
30172025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
30182025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30192025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30202025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
30212025-02-21T10:03:23.559ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30222025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30232025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
30242025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
30252025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30262025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30272025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30282025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
30292025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30302025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
30312025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30322025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30332025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
30342025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30352025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30362025-02-21T10:03:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30372025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30382025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30392025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
30402025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30412025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30422025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30432025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30442025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30452025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30462025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30472025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30482025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
30492025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30502025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30512025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
30522025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30532025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30542025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30552025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30562025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30572025-02-21T10:03:23.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d154e9e-6d90-4040-b311-004f0e299e85.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e63432d-4205-48df-bd2b-03a054e87ab0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1401, tv_nsec: 857084289 } })
30582025-02-21T10:03:23.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3bf841e1-42b9-4bd7-ac20-7644b8a83464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1401, tv_nsec: 857101039 } })
30592025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30602025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30612025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30622025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30632025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30642025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
30652025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.087586ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
30662025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
30672025-02-21T10:03:23.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.307581ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
30682025-02-21T10:03:23.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30692025-02-21T10:03:23.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30702025-02-21T10:03:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30712025-02-21T10:03:23.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.13687ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
30722025-02-21T10:03:23.563ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1401, tv_nsec: 860432190 } })
30732025-02-21T10:03:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30742025-02-21T10:03:23.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30752025-02-21T10:03:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30762025-02-21T10:03:23.563ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
30772025-02-21T10:03:23.563ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30782025-02-21T10:03:23.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.934253ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
30792025-02-21T10:03:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
30802025-02-21T10:03:23.565ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30812025-02-21T10:03:23.565ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30822025-02-21T10:03:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30832025-02-21T10:03:23.566ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30842025-02-21T10:03:23.567ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30852025-02-21T10:03:23.567ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1401, tv_nsec: 864652991 } })
30862025-02-21T10:03:23.568ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
30872025-02-21T10:03:23.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
30882025-02-21T10:03:23.568ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
30892025-02-21T10:03:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
30902025-02-21T10:03:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30912025-02-21T10:03:23.568ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30922025-02-21T10:03:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30932025-02-21T10:03:23.569ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30942025-02-21T10:03:23.569ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30952025-02-21T10:03:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30962025-02-21T10:03:23.570ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-21 09:53:23.559548287 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
30972025-02-21T10:03:23.570ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.159529ms iteration = 6 status = {"expiration":"2025-02-21T09:53:23.559548287Z","pruned":[]}
30982025-02-21T10:03:23.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30992025-02-21T10:03:23.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31002025-02-21T10:03:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31012025-02-21T10:03:23.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31022025-02-21T10:03:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31032025-02-21T10:03:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
31042025-02-21T10:03:23.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31052025-02-21T10:03:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31062025-02-21T10:03:23.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31072025-02-21T10:03:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31082025-02-21T10:03:23.576ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31092025-02-21T10:03:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31102025-02-21T10:03:23.577ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.875752ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
31112025-02-21T10:03:23.578ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 18.898636ms iteration = 11 status = {"errors":[],"requests_created_ok":[]}
31122025-02-21T10:03:23.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31132025-02-21T10:03:23.579ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31142025-02-21T10:03:23.579ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31152025-02-21T10:03:23.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31162025-02-21T10:03:23.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31172025-02-21T10:03:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31182025-02-21T10:03:23.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31192025-02-21T10:03:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31202025-02-21T10:03:23.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31212025-02-21T10:03:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31222025-02-21T10:03:23.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31232025-02-21T10:03:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31242025-02-21T10:03:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31252025-02-21T10:03:23.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31262025-02-21T10:03:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31272025-02-21T10:03:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31282025-02-21T10:03:23.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31292025-02-21T10:03:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31302025-02-21T10:03:23.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31312025-02-21T10:03:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31322025-02-21T10:03:23.586ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31332025-02-21T10:03:23.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31342025-02-21T10:03:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31352025-02-21T10:03:23.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31362025-02-21T10:03:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31372025-02-21T10:03:23.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
31382025-02-21T10:03:23.589ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
31392025-02-21T10:03:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
31402025-02-21T10:03:23.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31412025-02-21T10:03:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31422025-02-21T10:03:23.591ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31432025-02-21T10:03:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31442025-02-21T10:03:23.592ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31452025-02-21T10:03:23.592ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31462025-02-21T10:03:23.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31472025-02-21T10:03:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31482025-02-21T10:03:23.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31492025-02-21T10:03:23.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1401, tv_nsec: 892137695 } })
31502025-02-21T10:03:23.595ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
31512025-02-21T10:03:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31522025-02-21T10:03:23.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31532025-02-21T10:03:23.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31542025-02-21T10:03:23.598ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31552025-02-21T10:03:23.598ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 39.104043ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31562025-02-21T10:03:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31572025-02-21T10:03:23.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31582025-02-21T10:03:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31592025-02-21T10:03:23.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31602025-02-21T10:03:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31612025-02-21T10:03:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
31622025-02-21T10:03:23.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31632025-02-21T10:03:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31642025-02-21T10:03:23.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31652025-02-21T10:03:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
31662025-02-21T10:03:23.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31672025-02-21T10:03:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31682025-02-21T10:03:23.613ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
31692025-02-21T10:03:23.613ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
31702025-02-21T10:03:23.613ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 54.152807ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
31712025-02-21T10:03:23.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31722025-02-21T10:03:23.614ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31732025-02-21T10:03:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31742025-02-21T10:03:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31752025-02-21T10:03:23.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.169223ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31762025-02-21T10:03:23.625ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31772025-02-21T10:03:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31782025-02-21T10:03:23.626ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31792025-02-21T10:03:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31802025-02-21T10:03:23.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31812025-02-21T10:03:23.628ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31822025-02-21T10:03:23.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31832025-02-21T10:03:23.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31842025-02-21T10:03:23.628ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31852025-02-21T10:03:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31862025-02-21T10:03:23.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31872025-02-21T10:03:23.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31882025-02-21T10:03:23.631ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31892025-02-21T10:03:23.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.831674ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31902025-02-21T10:03:23.631ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31912025-02-21T10:03:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31922025-02-21T10:03:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31932025-02-21T10:03:23.632ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
31942025-02-21T10:03:23.632ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
31952025-02-21T10:03:23.632ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.472773ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
31962025-02-21T10:03:23.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
31972025-02-21T10:03:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
31982025-02-21T10:03:23.635ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31992025-02-21T10:03:23.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32002025-02-21T10:03:23.636ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32012025-02-21T10:03:23.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32022025-02-21T10:03:23.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32032025-02-21T10:03:23.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32042025-02-21T10:03:23.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32052025-02-21T10:03:23.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32062025-02-21T10:03:23.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32072025-02-21T10:03:23.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082025-02-21T10:03:23.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32092025-02-21T10:03:23.640ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32102025-02-21T10:03:23.640ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32112025-02-21T10:03:23.640ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32122025-02-21T10:03:23.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32132025-02-21T10:03:23.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142025-02-21T10:03:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32152025-02-21T10:03:23.641ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
32162025-02-21T10:03:23.641ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.285886ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
32172025-02-21T10:03:23.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32182025-02-21T10:03:23.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
32192025-02-21T10:03:23.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32202025-02-21T10:03:23.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32212025-02-21T10:03:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32222025-02-21T10:03:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32232025-02-21T10:03:23.645ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32242025-02-21T10:03:23.646ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32252025-02-21T10:03:23.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32262025-02-21T10:03:23.647ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32272025-02-21T10:03:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32282025-02-21T10:03:23.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32292025-02-21T10:03:23.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32302025-02-21T10:03:23.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
32312025-02-21T10:03:23.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32322025-02-21T10:03:23.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32332025-02-21T10:03:23.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32342025-02-21T10:03:23.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32352025-02-21T10:03:23.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32362025-02-21T10:03:23.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32372025-02-21T10:03:23.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
32382025-02-21T10:03:23.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32392025-02-21T10:03:23.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32402025-02-21T10:03:23.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32412025-02-21T10:03:23.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32422025-02-21T10:03:23.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32432025-02-21T10:03:23.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32442025-02-21T10:03:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32452025-02-21T10:03:23.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32462025-02-21T10:03:23.658ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32472025-02-21T10:03:23.658ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 0 version = 2
32482025-02-21T10:03:23.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32492025-02-21T10:03:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
32502025-02-21T10:03:23.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32512025-02-21T10:03:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32522025-02-21T10:03:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32532025-02-21T10:03:23.658ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32542025-02-21T10:03:23.658ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32552025-02-21T10:03:23.659ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.211605ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32562025-02-21T10:03:23.660ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32572025-02-21T10:03:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32582025-02-21T10:03:23.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32592025-02-21T10:03:23.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32602025-02-21T10:03:23.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32612025-02-21T10:03:23.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32622025-02-21T10:03:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32632025-02-21T10:03:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32642025-02-21T10:03:23.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32652025-02-21T10:03:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32662025-02-21T10:03:23.663ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.234386ms iteration = 11 status = 0
32672025-02-21T10:03:23.666ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32682025-02-21T10:03:23.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32692025-02-21T10:03:23.670ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32702025-02-21T10:03:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
32712025-02-21T10:03:23.670ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32722025-02-21T10:03:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32732025-02-21T10:03:23.671ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
32742025-02-21T10:03:23.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32752025-02-21T10:03:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32762025-02-21T10:03:23.675ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 1 version = 2
32772025-02-21T10:03:23.675ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32782025-02-21T10:03:23.675ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 116.263956ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32792025-02-21T10:03:23.675ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-21 09:58:29.727106 UTC dns_group = external generation = 2
32802025-02-21T10:03:23.675ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 116.056382ms iteration = 6 status = {"generation":2}
32812025-02-21T10:03:23.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32822025-02-21T10:03:23.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32832025-02-21T10:03:23.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32842025-02-21T10:03:23.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
32852025-02-21T10:03:23.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
32862025-02-21T10:03:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
32872025-02-21T10:03:23.680ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32882025-02-21T10:03:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32892025-02-21T10:03:23.684ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32902025-02-21T10:03:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32912025-02-21T10:03:23.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32922025-02-21T10:03:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32932025-02-21T10:03:23.687ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
32942025-02-21T10:03:23.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.626555ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32952025-02-21T10:03:23.689ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32962025-02-21T10:03:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32972025-02-21T10:03:23.690ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-21T09:58:18.895783Z, time_modified: 2025-02-21T09:58:18.895783Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }) }
32982025-02-21T10:03:23.690ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 130.52117ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]}},"default_endpoint":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
32992025-02-21T10:03:23.690ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 131.059844ms iteration = 4 status = {"blueprint_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","inventory_collection_id":"6dabbb05-9197-4c70-95a7-43961580e538","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
33002025-02-21T10:03:23.691ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33012025-02-21T10:03:23.691ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33022025-02-21T10:03:23.691ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33032025-02-21T10:03:23.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33042025-02-21T10:03:23.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33052025-02-21T10:03:23.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33062025-02-21T10:03:23.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33072025-02-21T10:03:23.692ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.464748ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
33082025-02-21T10:03:23.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33092025-02-21T10:03:23.693ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33102025-02-21T10:03:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33112025-02-21T10:03:23.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33122025-02-21T10:03:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33132025-02-21T10:03:23.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
33142025-02-21T10:03:23.698ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33152025-02-21T10:03:23.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33162025-02-21T10:03:23.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33172025-02-21T10:03:23.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33182025-02-21T10:03:23.704ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33192025-02-21T10:03:23.705ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
33202025-02-21T10:03:23.705ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 145.956133ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
33212025-02-21T10:03:23.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
33222025-02-21T10:03:23.713ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33232025-02-21T10:03:23.713ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c330e0e-b181-42e3-b62b-d0bf30cd67e2", "content-length": "26", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
33242025-02-21T10:03:23.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33252025-02-21T10:03:23.714ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33262025-02-21T10:03:23.717ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
33272025-02-21T10:03:23.717ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33282025-02-21T10:03:23.717ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ba9facb-ddd5-421d-9879-38346fef0383", "content-length": "26", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
33292025-02-21T10:03:23.717ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33302025-02-21T10:03:23.719ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33312025-02-21T10:03:23.733ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33322025-02-21T10:03:23.733ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33332025-02-21T10:03:23.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33342025-02-21T10:03:23.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33352025-02-21T10:03:23.736ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
33362025-02-21T10:03:23.736ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 176.569642ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33372025-02-21T10:03:23.736ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 177.212678ms iteration = 13 status = {"physical_disks_added":0}
33382025-02-21T10:03:23.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33392025-02-21T10:03:23.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33402025-02-21T10:03:23.797ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
33412025-02-21T10:03:23.797ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33422025-02-21T10:03:23.797ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b469642-939c-4c59-a7f4-d97a6b708470", "content-length": "26", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
33432025-02-21T10:03:23.797ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33442025-02-21T10:03:23.799ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
33452025-02-21T10:03:23.864ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33462025-02-21T10:03:23.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c6da718e-1607-46aa-81a8-c11e7c28ad40 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
33472025-02-21T10:03:23.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c6da718e-1607-46aa-81a8-c11e7c28ad40 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
33482025-02-21T10:03:23.920ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33492025-02-21T10:03:23.920ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33502025-02-21T10:03:23.921ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "50401176-f052-40a3-888f-2f4494c6b3bc", "content-length": "372", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
33512025-02-21T10:03:23.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33522025-02-21T10:03:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33532025-02-21T10:03:23.923ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33542025-02-21T10:03:23.924ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "42e147d6-b5ec-466f-b874-f28846ff2aef", "content-length": "1", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
33552025-02-21T10:03:23.926ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33562025-02-21T10:03:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33572025-02-21T10:03:23.930ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
33582025-02-21T10:03:23.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
33592025-02-21T10:03:23.932ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33602025-02-21T10:03:23.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33612025-02-21T10:03:23.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33622025-02-21T10:03:23.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33632025-02-21T10:03:23.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 31024 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c6da718e-1607-46aa-81a8-c11e7c28ad40 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
33642025-02-21T10:03:23.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33652025-02-21T10:03:23.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33662025-02-21T10:03:23.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33672025-02-21T10:03:23.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33682025-02-21T10:03:23.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33692025-02-21T10:03:23.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33702025-02-21T10:03:23.937ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33712025-02-21T10:03:23.937ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 378.442936ms iteration = 11 status = null
33722025-02-21T10:03:23.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33732025-02-21T10:03:23.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33742025-02-21T10:03:23.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
33752025-02-21T10:03:23.939ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
33762025-02-21T10:03:23.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33772025-02-21T10:03:23.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
33782025-02-21T10:03:23.940ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33792025-02-21T10:03:23.940ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33802025-02-21T10:03:23.940ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-21 09:58:29.164998 UTC dns_group = internal generation = 1
33812025-02-21T10:03:23.940ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 380.542026ms iteration = 6 status = {"generation":1}
33822025-02-21T10:03:23.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33832025-02-21T10:03:23.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33842025-02-21T10:03:23.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33852025-02-21T10:03:23.942ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
33862025-02-21T10:03:23.942ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33872025-02-21T10:03:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33882025-02-21T10:03:23.942ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "2043fa18-033f-4de9-be4c-8ff4f3af78b7", "content-length": "2", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
33892025-02-21T10:03:23.942ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:619 sled = http://[fd00:1122:3344:101::1]:12345
33902025-02-21T10:03:23.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33912025-02-21T10:03:23.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33922025-02-21T10:03:23.944ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 384.752908ms iteration = 2 status = {"last_run_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"operation":"list","target_sled":"9f7d1cf8-48de-4890-ab3d-e135f2248edc","time":"2025-02-21T10:03:23.942948572Z"}]}
33932025-02-21T10:03:23.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33942025-02-21T10:03:23.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33952025-02-21T10:03:23.946ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
33962025-02-21T10:03:23.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33972025-02-21T10:03:23.947ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33982025-02-21T10:03:23.947ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "539e2f31-77f5-430f-987e-b9d7ea54ba17", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
33992025-02-21T10:03:23.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34002025-02-21T10:03:23.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34012025-02-21T10:03:23.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34022025-02-21T10:03:23.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34032025-02-21T10:03:23.950ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
34042025-02-21T10:03:23.950ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34052025-02-21T10:03:23.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34062025-02-21T10:03:24.010ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34072025-02-21T10:03:24.011ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b6bdb028-7831-4c47-9304-84ee38dffa83", "date": "Fri, 21 Feb 2025 10:03:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34082025-02-21T10:03:24.011ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34092025-02-21T10:03:24.012ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "99465469-4405-4ca0-9374-54c8d0ddfc5d", "date": "Fri, 21 Feb 2025 10:03:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34102025-02-21T10:03:24.012ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34112025-02-21T10:03:24.014ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "db83ba5e-abd8-48a0-aa3b-20fe6c7819a6", "date": "Fri, 21 Feb 2025 10:03:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34122025-02-21T10:03:24.014ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34132025-02-21T10:03:24.015ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34142025-02-21T10:03:24.015ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 456.117931ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34152025-02-21T10:03:24.031ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
34162025-02-21T10:03:24.031ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0b28875b-9679-4a41-aaf6-4e9f2cec1711", "date": "Fri, 21 Feb 2025 10:03:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34172025-02-21T10:03:24.031ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34182025-02-21T10:03:24.033ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "974b6ada-954d-494d-a828-065e7c365e60", "date": "Fri, 21 Feb 2025 10:03:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34192025-02-21T10:03:24.033ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34202025-02-21T10:03:24.034ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34212025-02-21T10:03:24.034ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 475.196211ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34222025-02-21T10:03:24.037ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 477.760163ms iteration = 11 status = {}
34232025-02-21T10:03:24.048ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34242025-02-21T10:03:24.049ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aefb4662-58e8-4939-a2c2-7d5f55b2652b", "content-length": "691", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
34252025-02-21T10:03:24.049ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
34262025-02-21T10:03:24.049ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
34272025-02-21T10:03:24.049ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
34282025-02-21T10:03:24.050ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 490.737977ms iteration = 11 status = {}
34292025-02-21T10:03:24.050ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34302025-02-21T10:03:24.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34312025-02-21T10:03:24.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34322025-02-21T10:03:24.052ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34332025-02-21T10:03:24.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34342025-02-21T10:03:24.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34352025-02-21T10:03:24.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34362025-02-21T10:03:24.055ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34372025-02-21T10:03:24.055ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34382025-02-21T10:03:24.055ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7d0e6322-bf6b-48aa-9a99-4e4ae7de1b9b", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
34392025-02-21T10:03:24.057ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 497.48437ms iteration = 11 status = {}
34402025-02-21T10:03:24.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
34412025-02-21T10:03:24.057ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34422025-02-21T10:03:24.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34432025-02-21T10:03:24.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34442025-02-21T10:03:24.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34452025-02-21T10:03:24.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34462025-02-21T10:03:24.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34472025-02-21T10:03:24.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34482025-02-21T10:03:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34492025-02-21T10:03:24.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34502025-02-21T10:03:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34512025-02-21T10:03:24.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34522025-02-21T10:03:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34532025-02-21T10:03:24.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34542025-02-21T10:03:24.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34552025-02-21T10:03:24.072ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34562025-02-21T10:03:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34572025-02-21T10:03:24.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34582025-02-21T10:03:24.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
34592025-02-21T10:03:24.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34602025-02-21T10:03:24.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34612025-02-21T10:03:24.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34622025-02-21T10:03:24.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34632025-02-21T10:03:24.079ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34642025-02-21T10:03:24.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34652025-02-21T10:03:24.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34662025-02-21T10:03:24.083ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
34672025-02-21T10:03:24.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34682025-02-21T10:03:24.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34692025-02-21T10:03:24.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34702025-02-21T10:03:24.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34712025-02-21T10:03:24.090ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 297e1ece-21a5-4e9a-97ed-81e96ccfe78d, kind: Service { id: 0a6b3afe-b742-4846-b618-6c7f1a45f298 }, name: Name("nexus-0a6b3afe-b742-4846-b618-6c7f1a45f298"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e11ed28-c8e5-4904-8d4a-018d5b3b74e6, kind: Service { id: 78cc7a50-acf8-416c-b0e8-3080705dc078 }, name: Name("nexus-78cc7a50-acf8-416c-b0e8-3080705dc078"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 71])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b89732c-7664-4050-9a75-ef3f22ab224c, kind: Service { id: 91873638-4636-473a-93ff-2169ae6acba5 }, name: Name("nexus-91873638-4636-473a-93ff-2169ae6acba5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 219])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 4c4377b4-8dba-407d-9f3b-24ff09cc2957, kind: Service { id: 5eee7a17-bcfb-4922-9f12-263ce2aa9c0f }, name: Name("external-dns-5eee7a17-bcfb-4922-9f12-263ce2aa9c0f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff8ce111-7b5c-4a52-b63c-cc7123970750, kind: Service { id: 3bf841e1-42b9-4bd7-ac20-7644b8a83464 }, name: Name("external-dns-3bf841e1-42b9-4bd7-ac20-7644b8a83464"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
34722025-02-21T10:03:24.090ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34732025-02-21T10:03:24.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34742025-02-21T10:03:24.090ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
34752025-02-21T10:03:24.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34762025-02-21T10:03:24.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34772025-02-21T10:03:24.091ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34782025-02-21T10:03:24.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
34792025-02-21T10:03:24.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34802025-02-21T10:03:24.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34812025-02-21T10:03:24.094ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
34822025-02-21T10:03:24.094ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4c4377b4-8dba-407d-9f3b-24ff09cc2957, kind: Service { id: 5eee7a17-bcfb-4922-9f12-263ce2aa9c0f }, name: Name("external-dns-5eee7a17-bcfb-4922-9f12-263ce2aa9c0f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff8ce111-7b5c-4a52-b63c-cc7123970750, kind: Service { id: 3bf841e1-42b9-4bd7-ac20-7644b8a83464 }, name: Name("external-dns-3bf841e1-42b9-4bd7-ac20-7644b8a83464"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 297e1ece-21a5-4e9a-97ed-81e96ccfe78d, kind: Service { id: 0a6b3afe-b742-4846-b618-6c7f1a45f298 }, name: Name("nexus-0a6b3afe-b742-4846-b618-6c7f1a45f298"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e11ed28-c8e5-4904-8d4a-018d5b3b74e6, kind: Service { id: 78cc7a50-acf8-416c-b0e8-3080705dc078 }, name: Name("nexus-78cc7a50-acf8-416c-b0e8-3080705dc078"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 71])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b89732c-7664-4050-9a75-ef3f22ab224c, kind: Service { id: 91873638-4636-473a-93ff-2169ae6acba5 }, name: Name("nexus-91873638-4636-473a-93ff-2169ae6acba5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 219])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
34832025-02-21T10:03:24.094ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
34842025-02-21T10:03:24.169ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, time_created: 2025-02-21T09:58:29.353603Z, time_modified: 2025-02-21T09:58:29.353603Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
34852025-02-21T10:03:24.169ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
34862025-02-21T10:03:24.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34872025-02-21T10:03:24.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34882025-02-21T10:03:24.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34892025-02-21T10:03:24.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34902025-02-21T10:03:24.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34912025-02-21T10:03:24.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
34922025-02-21T10:03:24.197ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34932025-02-21T10:03:24.197ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "78f4d6de-9681-4cde-ab53-31c1ab9ce574", "content-length": "134", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
34942025-02-21T10:03:24.197ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34952025-02-21T10:03:24.197ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
34962025-02-21T10:03:24.197ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34972025-02-21T10:03:24.197ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34982025-02-21T10:03:24.197ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34992025-02-21T10:03:24.197ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35002025-02-21T10:03:24.197ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35012025-02-21T10:03:24.197ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35022025-02-21T10:03:24.197ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35032025-02-21T10:03:24.197ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35042025-02-21T10:03:24.198ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
35052025-02-21T10:03:24.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35062025-02-21T10:03:24.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35072025-02-21T10:03:24.200ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35082025-02-21T10:03:24.200ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "88517061-f47d-4444-abf3-a99248ee5a5c", "content-length": "2", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
35092025-02-21T10:03:24.200ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35102025-02-21T10:03:24.200ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f82256dd-c881-4869-bee5-fca61ffc7776", "content-length": "52", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
35112025-02-21T10:03:24.200ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
35122025-02-21T10:03:24.200ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35132025-02-21T10:03:24.208ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
35142025-02-21T10:03:24.297ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d0780852-351c-45c1-a7b0-c36cf7eaf4a9", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
35152025-02-21T10:03:24.297ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
35162025-02-21T10:03:24.297ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35172025-02-21T10:03:24.298ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e80bf16-c163-4fc0-a3ec-91ffe4ef0fcf", "content-length": "682", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
35182025-02-21T10:03:24.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35192025-02-21T10:03:24.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35202025-02-21T10:03:24.298ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "c132702a-32fb-4825-9afe-d13598f6182e", "date": "Fri, 21 Feb 2025 10:03:23 GMT"} })
35212025-02-21T10:03:24.300ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
35222025-02-21T10:03:24.300ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 740.496586ms
35232025-02-21T10:03:24.300ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 740.505807ms iteration = 2 status = {}
35242025-02-21T10:03:24.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35252025-02-21T10:03:24.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35262025-02-21T10:03:24.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35272025-02-21T10:03:24.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35282025-02-21T10:03:24.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35292025-02-21T10:03:24.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35302025-02-21T10:03:24.316ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 756.493372ms iteration = 11 status = {}
35312025-02-21T10:03:24.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 318d80d1-5215-4354-929d-5e6c12de52c0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35322025-02-21T10:03:24.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 318d80d1-5215-4354-929d-5e6c12de52c0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35332025-02-21T10:03:24.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1873 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 318d80d1-5215-4354-929d-5e6c12de52c0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35342025-02-21T10:03:25.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8ccd270d-e489-4ea1-b19a-b6991e101a85 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35352025-02-21T10:03:25.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8ccd270d-e489-4ea1-b19a-b6991e101a85 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35362025-02-21T10:03:25.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8ccd270d-e489-4ea1-b19a-b6991e101a85 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35372025-02-21T10:03:26.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 513 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = be82be9b-97f5-46b8-ab16-96f16f4a0e69 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
35382025-02-21T10:03:26.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e3b99b98-1c8e-47e9-8ce1-dee345054b69 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35392025-02-21T10:03:26.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e3b99b98-1c8e-47e9-8ce1-dee345054b69 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35402025-02-21T10:03:26.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e3b99b98-1c8e-47e9-8ce1-dee345054b69 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35412025-02-21T10:03:28.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 35a5054a-3c37-4baa-911a-c96d02d34b6f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35422025-02-21T10:03:28.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 35a5054a-3c37-4baa-911a-c96d02d34b6f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35432025-02-21T10:03:28.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 35a5054a-3c37-4baa-911a-c96d02d34b6f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35442025-02-21T10:03:29.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0f88803c-85e4-488c-b322-8e12e1619779 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35452025-02-21T10:03:29.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0f88803c-85e4-488c-b322-8e12e1619779 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35462025-02-21T10:03:29.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1845 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0f88803c-85e4-488c-b322-8e12e1619779 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35472025-02-21T10:03:30.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9aa71ce2-326f-448a-9587-ff2e7e62cc4e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35482025-02-21T10:03:30.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9aa71ce2-326f-448a-9587-ff2e7e62cc4e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35492025-02-21T10:03:30.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9aa71ce2-326f-448a-9587-ff2e7e62cc4e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35502025-02-21T10:03:31.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4a111fec-81c8-4222-b3ca-0ac7c3a84081 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35512025-02-21T10:03:31.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4a111fec-81c8-4222-b3ca-0ac7c3a84081 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35522025-02-21T10:03:31.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1965 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4a111fec-81c8-4222-b3ca-0ac7c3a84081 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35532025-02-21T10:03:32.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b773bc21-32cf-4d79-9458-c0fd9ffcaafd roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35542025-02-21T10:03:32.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b773bc21-32cf-4d79-9458-c0fd9ffcaafd resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35552025-02-21T10:03:32.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2023 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b773bc21-32cf-4d79-9458-c0fd9ffcaafd response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35562025-02-21T10:03:33.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 47f1b2ae-c314-4e88-b4f6-be28320afffe roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35572025-02-21T10:03:33.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 47f1b2ae-c314-4e88-b4f6-be28320afffe resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35582025-02-21T10:03:33.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 47f1b2ae-c314-4e88-b4f6-be28320afffe response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35592025-02-21T10:03:33.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
35602025-02-21T10:03:33.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
35612025-02-21T10:03:33.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35622025-02-21T10:03:33.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35632025-02-21T10:03:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35642025-02-21T10:03:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35652025-02-21T10:03:33.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35662025-02-21T10:03:33.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35672025-02-21T10:03:33.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35682025-02-21T10:03:33.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.667779ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35692025-02-21T10:03:33.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35702025-02-21T10:03:33.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35712025-02-21T10:03:33.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35722025-02-21T10:03:33.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35732025-02-21T10:03:33.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35742025-02-21T10:03:33.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752025-02-21T10:03:33.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
35762025-02-21T10:03:33.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35772025-02-21T10:03:33.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35782025-02-21T10:03:33.577ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
35792025-02-21T10:03:33.577ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.297141ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
35802025-02-21T10:03:34.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9ad7a62c-6136-493e-946a-19863d4f382c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35812025-02-21T10:03:34.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9ad7a62c-6136-493e-946a-19863d4f382c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35822025-02-21T10:03:34.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9ad7a62c-6136-493e-946a-19863d4f382c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35832025-02-21T10:03:35.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c579d1bc-8f09-4638-bed3-5221cbb19b20 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35842025-02-21T10:03:35.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c579d1bc-8f09-4638-bed3-5221cbb19b20 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35852025-02-21T10:03:35.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2685 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c579d1bc-8f09-4638-bed3-5221cbb19b20 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35862025-02-21T10:03:36.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a20aeb18-c74e-4751-80a6-4260c526c4d3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35872025-02-21T10:03:36.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a20aeb18-c74e-4751-80a6-4260c526c4d3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35882025-02-21T10:03:36.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1796 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a20aeb18-c74e-4751-80a6-4260c526c4d3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35892025-02-21T10:03:36.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 461 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 6f28aaab-a234-4944-aa5a-6f656f472fa3 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
35902025-02-21T10:03:37.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = caf10a27-b03f-4dda-9c20-3e7b85d217e5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35912025-02-21T10:03:37.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = caf10a27-b03f-4dda-9c20-3e7b85d217e5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35922025-02-21T10:03:37.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = caf10a27-b03f-4dda-9c20-3e7b85d217e5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35932025-02-21T10:03:38.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b5f7321f-979c-4a52-967c-410c72cf499c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35942025-02-21T10:03:38.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b5f7321f-979c-4a52-967c-410c72cf499c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35952025-02-21T10:03:38.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b5f7321f-979c-4a52-967c-410c72cf499c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35962025-02-21T10:03:39.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a08dbaf3-5997-4328-9ac4-1d821b7260b6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35972025-02-21T10:03:39.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a08dbaf3-5997-4328-9ac4-1d821b7260b6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35982025-02-21T10:03:39.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1965 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a08dbaf3-5997-4328-9ac4-1d821b7260b6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
35992025-02-21T10:03:40.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 92cc7557-03a7-41c8-b38b-3fcec865c222 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36002025-02-21T10:03:40.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 92cc7557-03a7-41c8-b38b-3fcec865c222 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36012025-02-21T10:03:40.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2034 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 92cc7557-03a7-41c8-b38b-3fcec865c222 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36022025-02-21T10:03:41.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3063e54f-edb3-4114-9784-c0e79954bcdd roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36032025-02-21T10:03:41.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3063e54f-edb3-4114-9784-c0e79954bcdd resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36042025-02-21T10:03:41.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3063e54f-edb3-4114-9784-c0e79954bcdd response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36052025-02-21T10:03:42.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 25f69bb4-b949-4a6d-abd8-a3c30502b927 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36062025-02-21T10:03:42.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 25f69bb4-b949-4a6d-abd8-a3c30502b927 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36072025-02-21T10:03:42.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 25f69bb4-b949-4a6d-abd8-a3c30502b927 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36082025-02-21T10:03:43.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c759349c-93a7-4948-8448-993d72901ff4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36092025-02-21T10:03:43.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c759349c-93a7-4948-8448-993d72901ff4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36102025-02-21T10:03:43.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c759349c-93a7-4948-8448-993d72901ff4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36112025-02-21T10:03:43.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
36122025-02-21T10:03:43.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
36132025-02-21T10:03:43.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36142025-02-21T10:03:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36152025-02-21T10:03:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36162025-02-21T10:03:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36172025-02-21T10:03:43.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36182025-02-21T10:03:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36192025-02-21T10:03:43.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36202025-02-21T10:03:43.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.132006ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36212025-02-21T10:03:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36222025-02-21T10:03:43.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36232025-02-21T10:03:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36242025-02-21T10:03:43.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36252025-02-21T10:03:43.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36262025-02-21T10:03:43.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36272025-02-21T10:03:43.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
36282025-02-21T10:03:43.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36292025-02-21T10:03:43.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36302025-02-21T10:03:43.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
36312025-02-21T10:03:43.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.820686ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
36322025-02-21T10:03:44.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3cbfc5c9-4c5f-4de9-b2a5-7a02b704f30b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36332025-02-21T10:03:44.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3cbfc5c9-4c5f-4de9-b2a5-7a02b704f30b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36342025-02-21T10:03:44.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2613 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3cbfc5c9-4c5f-4de9-b2a5-7a02b704f30b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36352025-02-21T10:03:45.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4e15e6ab-f875-448c-8253-9515e3fa0376 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36362025-02-21T10:03:45.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4e15e6ab-f875-448c-8253-9515e3fa0376 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36372025-02-21T10:03:45.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1897 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4e15e6ab-f875-448c-8253-9515e3fa0376 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36382025-02-21T10:03:46.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 22883407-497e-4539-aa91-75c97f580824 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36392025-02-21T10:03:46.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 22883407-497e-4539-aa91-75c97f580824 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36402025-02-21T10:03:46.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 22883407-497e-4539-aa91-75c97f580824 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36412025-02-21T10:03:46.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 463 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 574c0bc4-7a97-4d5a-9ba2-cff81a9c74ee response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
36422025-02-21T10:03:47.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 05f6d5cb-3d59-4492-87f5-59b60b75a765 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36432025-02-21T10:03:47.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 05f6d5cb-3d59-4492-87f5-59b60b75a765 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36442025-02-21T10:03:47.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1953 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 05f6d5cb-3d59-4492-87f5-59b60b75a765 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36452025-02-21T10:03:48.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0c7a5504-9608-4bb2-8b50-67a396bf79dd roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36462025-02-21T10:03:48.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0c7a5504-9608-4bb2-8b50-67a396bf79dd resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36472025-02-21T10:03:48.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0c7a5504-9608-4bb2-8b50-67a396bf79dd response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36482025-02-21T10:03:49.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 88f51ac5-4bd0-4087-a1f7-9b66ed5cc9dc roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36492025-02-21T10:03:49.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 88f51ac5-4bd0-4087-a1f7-9b66ed5cc9dc resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36502025-02-21T10:03:49.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 88f51ac5-4bd0-4087-a1f7-9b66ed5cc9dc response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36512025-02-21T10:03:50.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 88648dbb-a485-4c1e-a7ec-628d93d1b936 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36522025-02-21T10:03:50.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 88648dbb-a485-4c1e-a7ec-628d93d1b936 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36532025-02-21T10:03:50.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 88648dbb-a485-4c1e-a7ec-628d93d1b936 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36542025-02-21T10:03:51.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d366ed24-2f56-4d0e-8a0c-9aedb564ec15 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36552025-02-21T10:03:51.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d366ed24-2f56-4d0e-8a0c-9aedb564ec15 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36562025-02-21T10:03:51.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d366ed24-2f56-4d0e-8a0c-9aedb564ec15 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36572025-02-21T10:03:52.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 91a2533e-f858-4f2f-9c77-1096cc7cba79 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36582025-02-21T10:03:52.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 91a2533e-f858-4f2f-9c77-1096cc7cba79 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36592025-02-21T10:03:52.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 91a2533e-f858-4f2f-9c77-1096cc7cba79 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
36602025-02-21T10:03:53.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 60493621-757e-48fe-8068-a1baabd6a9b4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36612025-02-21T10:03:53.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 60493621-757e-48fe-8068-a1baabd6a9b4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36622025-02-21T10:03:53.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6875 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 60493621-757e-48fe-8068-a1baabd6a9b4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36632025-02-21T10:03:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
36642025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
36652025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36662025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36672025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
36682025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36692025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36702025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 12 reason = Timeout
36712025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
36722025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
36732025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36742025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
36752025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36762025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
36772025-02-21T10:03:53.559ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36782025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
36792025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36802025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36812025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
36822025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36832025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
36842025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36852025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
36862025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
36872025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36882025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36892025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
36902025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
36912025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36922025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36932025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
36942025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36952025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
36962025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
36972025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36982025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
36992025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37002025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
37012025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37022025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37032025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37042025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37052025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37062025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37072025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
37082025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37092025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37102025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37112025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37122025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37132025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37142025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37152025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37162025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37172025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37182025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37192025-02-21T10:03:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37202025-02-21T10:03:53.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37212025-02-21T10:03:53.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37222025-02-21T10:03:53.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37232025-02-21T10:03:53.562ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.419683ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37242025-02-21T10:03:53.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37252025-02-21T10:03:53.562ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37262025-02-21T10:03:53.562ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37272025-02-21T10:03:53.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37282025-02-21T10:03:53.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37292025-02-21T10:03:53.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.592941ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
37302025-02-21T10:03:53.565ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1431, tv_nsec: 862318385 } })
37312025-02-21T10:03:53.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37322025-02-21T10:03:53.565ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
37332025-02-21T10:03:53.565ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37342025-02-21T10:03:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37352025-02-21T10:03:53.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37362025-02-21T10:03:53.566ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 7.737697ms iteration = 12 status = {"errors":[],"requests_created_ok":[]}
37372025-02-21T10:03:53.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37382025-02-21T10:03:53.567ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37392025-02-21T10:03:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37402025-02-21T10:03:53.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37412025-02-21T10:03:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37422025-02-21T10:03:53.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37432025-02-21T10:03:53.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1431, tv_nsec: 866860254 } })
37442025-02-21T10:03:53.570ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
37452025-02-21T10:03:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37462025-02-21T10:03:53.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37472025-02-21T10:03:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37482025-02-21T10:03:53.570ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37492025-02-21T10:03:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37502025-02-21T10:03:53.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37512025-02-21T10:03:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37522025-02-21T10:03:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37532025-02-21T10:03:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37542025-02-21T10:03:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37552025-02-21T10:03:53.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37562025-02-21T10:03:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37572025-02-21T10:03:53.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37582025-02-21T10:03:53.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37592025-02-21T10:03:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37602025-02-21T10:03:53.574ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.957135ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37612025-02-21T10:03:53.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37622025-02-21T10:03:53.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37632025-02-21T10:03:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37642025-02-21T10:03:53.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1def846c-37d8-446c-97c1-a6d16d68eaf3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
37652025-02-21T10:03:53.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1def846c-37d8-446c-97c1-a6d16d68eaf3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
37662025-02-21T10:03:53.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37672025-02-21T10:03:53.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37682025-02-21T10:03:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37692025-02-21T10:03:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37702025-02-21T10:03:53.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37712025-02-21T10:03:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37722025-02-21T10:03:53.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1431, tv_nsec: 876777934 } })
37732025-02-21T10:03:53.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
37742025-02-21T10:03:53.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37752025-02-21T10:03:53.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37762025-02-21T10:03:53.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37772025-02-21T10:03:53.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5017 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1def846c-37d8-446c-97c1-a6d16d68eaf3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
37782025-02-21T10:03:53.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37792025-02-21T10:03:53.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37802025-02-21T10:03:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37812025-02-21T10:03:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
37822025-02-21T10:03:53.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37832025-02-21T10:03:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37842025-02-21T10:03:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37852025-02-21T10:03:53.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37862025-02-21T10:03:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37872025-02-21T10:03:53.601ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
37882025-02-21T10:03:53.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.71427ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
37892025-02-21T10:03:53.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37902025-02-21T10:03:53.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.582112ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
37912025-02-21T10:03:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37922025-02-21T10:03:53.607ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37932025-02-21T10:03:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37942025-02-21T10:03:53.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 49.877264ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37952025-02-21T10:03:53.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37962025-02-21T10:03:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37972025-02-21T10:03:53.617ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37982025-02-21T10:03:53.617ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37992025-02-21T10:03:53.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38002025-02-21T10:03:53.617ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38012025-02-21T10:03:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38022025-02-21T10:03:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38032025-02-21T10:03:53.619ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38042025-02-21T10:03:53.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.05972ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38052025-02-21T10:03:53.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 61.198237ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
38062025-02-21T10:03:53.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38072025-02-21T10:03:53.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38082025-02-21T10:03:53.646ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
38092025-02-21T10:03:53.646ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38102025-02-21T10:03:53.646ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e25a4eb8-77ab-4ed4-b638-c77d8da286df", "content-length": "26", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
38112025-02-21T10:03:53.646ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38122025-02-21T10:03:53.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38132025-02-21T10:03:53.661ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
38142025-02-21T10:03:53.661ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38152025-02-21T10:03:53.661ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99ba0b68-70bb-4b00-bc98-0267f274314e", "content-length": "26", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
38162025-02-21T10:03:53.661ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38172025-02-21T10:03:53.663ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38182025-02-21T10:03:53.673ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
38192025-02-21T10:03:53.673ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38202025-02-21T10:03:53.673ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba4743b8-2a46-48d0-afb6-73db6cb28534", "content-length": "26", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
38212025-02-21T10:03:53.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38222025-02-21T10:03:53.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
38232025-02-21T10:03:53.679ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38242025-02-21T10:03:53.679ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38252025-02-21T10:03:53.679ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "35913c2b-71c4-4164-9d93-8c5421637b09", "content-length": "372", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
38262025-02-21T10:03:53.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38272025-02-21T10:03:53.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38282025-02-21T10:03:53.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38292025-02-21T10:03:53.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38302025-02-21T10:03:53.689ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38312025-02-21T10:03:53.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38322025-02-21T10:03:53.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38332025-02-21T10:03:53.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38342025-02-21T10:03:53.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38352025-02-21T10:03:53.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38362025-02-21T10:03:53.700ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38372025-02-21T10:03:53.701ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38382025-02-21T10:03:53.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38392025-02-21T10:03:53.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38402025-02-21T10:03:53.711ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38412025-02-21T10:03:53.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38422025-02-21T10:03:53.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 152.845849ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38432025-02-21T10:03:53.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38442025-02-21T10:03:53.713ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38452025-02-21T10:03:53.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
38462025-02-21T10:03:53.714ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38472025-02-21T10:03:53.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38482025-02-21T10:03:53.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
38492025-02-21T10:03:53.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38502025-02-21T10:03:53.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38512025-02-21T10:03:53.724ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 165.180007ms iteration = 12 status = 0
38522025-02-21T10:03:53.726ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38532025-02-21T10:03:53.726ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38542025-02-21T10:03:53.726ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.181945ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38552025-02-21T10:03:53.728ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 169.815399ms iteration = 12 status = {}
38562025-02-21T10:03:53.734ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
38572025-02-21T10:03:53.734ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38582025-02-21T10:03:53.734ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9e3dec20-dc06-4737-a3b7-fbd5ac7889a3", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
38592025-02-21T10:03:53.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38602025-02-21T10:03:53.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38612025-02-21T10:03:53.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38622025-02-21T10:03:53.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38632025-02-21T10:03:53.739ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38642025-02-21T10:03:53.740ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "70d454cb-03ab-4318-9f0f-3797250fa4cf", "content-length": "1", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
38652025-02-21T10:03:53.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38662025-02-21T10:03:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38672025-02-21T10:03:53.741ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38682025-02-21T10:03:53.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38692025-02-21T10:03:53.742ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38702025-02-21T10:03:53.742ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38712025-02-21T10:03:53.743ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fc2d1a85-65d6-4f2a-ac9d-c1bade1cbaba", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
38722025-02-21T10:03:53.743ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 184.426732ms iteration = 12 status = null
38732025-02-21T10:03:53.744ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
38742025-02-21T10:03:53.744ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 185.851746ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
38752025-02-21T10:03:53.745ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 186.170874ms iteration = 12 status = {}
38762025-02-21T10:03:53.779ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.317918ms iteration = 14 status = {"physical_disks_added":0}
38772025-02-21T10:03:53.817ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38782025-02-21T10:03:53.818ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "59e547c0-b6d5-432d-a0a7-3d11fef667ea", "content-length": "691", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
38792025-02-21T10:03:53.818ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
38802025-02-21T10:03:53.818ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
38812025-02-21T10:03:53.818ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
38822025-02-21T10:03:53.818ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 259.829952ms iteration = 12 status = {}
38832025-02-21T10:03:53.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38842025-02-21T10:03:53.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38852025-02-21T10:03:53.831ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
38862025-02-21T10:03:53.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38872025-02-21T10:03:53.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38882025-02-21T10:03:53.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38892025-02-21T10:03:53.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "172db2a6-8899-4c48-89d5-35242051de35", "content-length": "134", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
38902025-02-21T10:03:53.840ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38912025-02-21T10:03:53.840ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
38922025-02-21T10:03:53.840ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38932025-02-21T10:03:53.841ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38942025-02-21T10:03:53.841ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38952025-02-21T10:03:53.841ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38962025-02-21T10:03:53.841ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38972025-02-21T10:03:53.841ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38982025-02-21T10:03:53.841ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38992025-02-21T10:03:53.841ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39002025-02-21T10:03:53.841ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
39012025-02-21T10:03:53.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39022025-02-21T10:03:53.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39032025-02-21T10:03:53.843ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39042025-02-21T10:03:53.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "43bf015c-efb4-4928-83e5-146f2e477bc1", "content-length": "2", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
39052025-02-21T10:03:53.843ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39062025-02-21T10:03:53.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "43089190-4010-4df5-9cfb-241d4d86b0fb", "content-length": "52", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
39072025-02-21T10:03:53.843ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
39082025-02-21T10:03:53.843ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39092025-02-21T10:03:53.944ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9ca2fcdf-945a-4db4-80a9-d3840a68ae2a", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
39102025-02-21T10:03:53.944ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
39112025-02-21T10:03:53.944ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39122025-02-21T10:03:53.947ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c3d9473-f2f1-468b-96a4-5c8b8cf02665", "content-length": "682", "date": "Fri, 21 Feb 2025 10:03:53 GMT"} })
39132025-02-21T10:03:53.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39142025-02-21T10:03:53.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39152025-02-21T10:03:53.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39162025-02-21T10:03:53.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39172025-02-21T10:03:53.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39182025-02-21T10:03:53.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39192025-02-21T10:03:53.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39202025-02-21T10:03:53.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39212025-02-21T10:03:53.972ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 413.337108ms iteration = 12 status = {}
39222025-02-21T10:03:54.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0712df94-0312-4f7b-8aa4-bd98df2c55d2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39232025-02-21T10:03:54.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0712df94-0312-4f7b-8aa4-bd98df2c55d2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39242025-02-21T10:03:54.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2488 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0712df94-0312-4f7b-8aa4-bd98df2c55d2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39252025-02-21T10:03:55.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9539c97d-0663-4613-adcb-ae7ca662971a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39262025-02-21T10:03:55.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9539c97d-0663-4613-adcb-ae7ca662971a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39272025-02-21T10:03:55.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9539c97d-0663-4613-adcb-ae7ca662971a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39282025-02-21T10:03:56.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 828 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 605b4d06-935e-4bfb-abc3-81eebc760e4d response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
39292025-02-21T10:03:56.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 970aa411-b51d-4242-be90-3f778c037baf roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39302025-02-21T10:03:56.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 970aa411-b51d-4242-be90-3f778c037baf resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39312025-02-21T10:03:56.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2638 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 970aa411-b51d-4242-be90-3f778c037baf response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39322025-02-21T10:03:57.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 19086915-a6f3-4850-8e8c-e4baa357b159 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39332025-02-21T10:03:57.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 19086915-a6f3-4850-8e8c-e4baa357b159 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39342025-02-21T10:03:57.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 19086915-a6f3-4850-8e8c-e4baa357b159 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39352025-02-21T10:03:58.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f0e84d77-6d6b-49a1-bcb2-7a7fd94215ca roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39362025-02-21T10:03:58.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f0e84d77-6d6b-49a1-bcb2-7a7fd94215ca resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39372025-02-21T10:03:58.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f0e84d77-6d6b-49a1-bcb2-7a7fd94215ca response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39382025-02-21T10:03:59.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eb66a03b-4b0d-4942-a80c-c64daf392c04 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39392025-02-21T10:03:59.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eb66a03b-4b0d-4942-a80c-c64daf392c04 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39402025-02-21T10:03:59.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3283 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eb66a03b-4b0d-4942-a80c-c64daf392c04 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39412025-02-21T10:04:00.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dd7c2106-98f2-47fd-a24e-21261739ea49 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39422025-02-21T10:04:00.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dd7c2106-98f2-47fd-a24e-21261739ea49 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39432025-02-21T10:04:00.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2564 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dd7c2106-98f2-47fd-a24e-21261739ea49 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39442025-02-21T10:04:01.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4687e29a-ca41-44e4-9d8e-7d67d8d5a5a0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39452025-02-21T10:04:01.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4687e29a-ca41-44e4-9d8e-7d67d8d5a5a0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39462025-02-21T10:04:01.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1948 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4687e29a-ca41-44e4-9d8e-7d67d8d5a5a0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39472025-02-21T10:04:02.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a5977a92-a50d-42e5-a341-9f3c30f7e692 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39482025-02-21T10:04:02.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a5977a92-a50d-42e5-a341-9f3c30f7e692 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39492025-02-21T10:04:02.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1659 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a5977a92-a50d-42e5-a341-9f3c30f7e692 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39502025-02-21T10:04:03.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
39512025-02-21T10:04:03.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39522025-02-21T10:04:03.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
39532025-02-21T10:04:03.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39542025-02-21T10:04:03.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39552025-02-21T10:04:03.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39562025-02-21T10:04:03.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39572025-02-21T10:04:03.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39582025-02-21T10:04:03.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39592025-02-21T10:04:03.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39602025-02-21T10:04:03.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39612025-02-21T10:04:03.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39622025-02-21T10:04:03.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39632025-02-21T10:04:03.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
39642025-02-21T10:04:03.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39652025-02-21T10:04:03.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39662025-02-21T10:04:03.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
39672025-02-21T10:04:03.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.135616ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
39682025-02-21T10:04:03.595ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39692025-02-21T10:04:03.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39702025-02-21T10:04:03.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.53841ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39712025-02-21T10:04:03.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a49c6e3f-540b-4797-af4a-ea93f9827532 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39722025-02-21T10:04:03.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a49c6e3f-540b-4797-af4a-ea93f9827532 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39732025-02-21T10:04:03.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a49c6e3f-540b-4797-af4a-ea93f9827532 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39742025-02-21T10:04:04.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ecac7a83-be52-42de-947a-e5aff542313b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39752025-02-21T10:04:04.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ecac7a83-be52-42de-947a-e5aff542313b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39762025-02-21T10:04:04.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ecac7a83-be52-42de-947a-e5aff542313b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39772025-02-21T10:04:05.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 674539be-c0a6-4ce8-b951-403ad504aaf3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39782025-02-21T10:04:05.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 674539be-c0a6-4ce8-b951-403ad504aaf3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39792025-02-21T10:04:05.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 674539be-c0a6-4ce8-b951-403ad504aaf3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39802025-02-21T10:04:06.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 8e46bd96-bc13-4094-985b-b8087a8ced50 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
39812025-02-21T10:04:06.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 8e46bd96-bc13-4094-985b-b8087a8ced50 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
39822025-02-21T10:04:06.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2726 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 8e46bd96-bc13-4094-985b-b8087a8ced50 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
39832025-02-21T10:04:06.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 18f16bf3-bc34-42fb-98e0-a146782fd6b2 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
39842025-02-21T10:04:06.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 18f16bf3-bc34-42fb-98e0-a146782fd6b2 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
39852025-02-21T10:04:06.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43113 req_id = 18f16bf3-bc34-42fb-98e0-a146782fd6b2 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
39862025-02-21T10:04:06.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 511 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 5cfbf48a-f0f4-4223-9f1c-518f251e94d5 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
39872025-02-21T10:04:06.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3f84db92-f628-4c30-b5d8-ee6fd578120f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39882025-02-21T10:04:06.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3f84db92-f628-4c30-b5d8-ee6fd578120f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39892025-02-21T10:04:06.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3f84db92-f628-4c30-b5d8-ee6fd578120f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39902025-02-21T10:04:07.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 46998e19-661b-497b-9ffd-639ca2ef6486 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39912025-02-21T10:04:07.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 46998e19-661b-497b-9ffd-639ca2ef6486 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39922025-02-21T10:04:07.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 46998e19-661b-497b-9ffd-639ca2ef6486 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39932025-02-21T10:04:08.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3ad4aec7-e37a-4aa1-9767-22f6b91efd0a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39942025-02-21T10:04:08.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3ad4aec7-e37a-4aa1-9767-22f6b91efd0a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39952025-02-21T10:04:08.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3ad4aec7-e37a-4aa1-9767-22f6b91efd0a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39962025-02-21T10:04:09.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cacba826-f2ea-43f7-b748-ed5fa25c63ab roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39972025-02-21T10:04:09.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cacba826-f2ea-43f7-b748-ed5fa25c63ab resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39982025-02-21T10:04:09.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cacba826-f2ea-43f7-b748-ed5fa25c63ab response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
39992025-02-21T10:04:10.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 667ababd-d3cb-479e-8871-6d3e34277f87 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40002025-02-21T10:04:10.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 667ababd-d3cb-479e-8871-6d3e34277f87 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40012025-02-21T10:04:10.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 667ababd-d3cb-479e-8871-6d3e34277f87 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40022025-02-21T10:04:11.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5daeaf8a-c98d-4bc7-b362-30c60e7ca852 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40032025-02-21T10:04:11.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5daeaf8a-c98d-4bc7-b362-30c60e7ca852 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40042025-02-21T10:04:11.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2050 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5daeaf8a-c98d-4bc7-b362-30c60e7ca852 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40052025-02-21T10:04:13.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cfa66fc4-3f1a-460b-b733-d77ce57eb365 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40062025-02-21T10:04:13.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cfa66fc4-3f1a-460b-b733-d77ce57eb365 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40072025-02-21T10:04:13.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cfa66fc4-3f1a-460b-b733-d77ce57eb365 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40082025-02-21T10:04:13.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
40092025-02-21T10:04:13.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
40102025-02-21T10:04:13.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40112025-02-21T10:04:13.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40122025-02-21T10:04:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40132025-02-21T10:04:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40142025-02-21T10:04:13.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40152025-02-21T10:04:13.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162025-02-21T10:04:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40172025-02-21T10:04:13.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.229882ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40182025-02-21T10:04:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40192025-02-21T10:04:13.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40202025-02-21T10:04:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40212025-02-21T10:04:13.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40222025-02-21T10:04:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40232025-02-21T10:04:13.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40242025-02-21T10:04:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
40252025-02-21T10:04:13.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40262025-02-21T10:04:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40272025-02-21T10:04:13.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
40282025-02-21T10:04:13.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.998808ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
40292025-02-21T10:04:14.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7d02809-561c-4bf1-8396-ad2dd89e8461 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40302025-02-21T10:04:14.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7d02809-561c-4bf1-8396-ad2dd89e8461 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40312025-02-21T10:04:14.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7d02809-561c-4bf1-8396-ad2dd89e8461 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40322025-02-21T10:04:15.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03570267-7b42-4654-bab2-2f4253610652 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40332025-02-21T10:04:15.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03570267-7b42-4654-bab2-2f4253610652 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40342025-02-21T10:04:15.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2092 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03570267-7b42-4654-bab2-2f4253610652 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40352025-02-21T10:04:16.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ccdec1d4-c46e-4dc9-ba67-d9a5f6658e6d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40362025-02-21T10:04:16.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ccdec1d4-c46e-4dc9-ba67-d9a5f6658e6d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40372025-02-21T10:04:16.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ccdec1d4-c46e-4dc9-ba67-d9a5f6658e6d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40382025-02-21T10:04:16.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 473 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = afbba884-6d82-4cea-b41c-4dd1db79b988 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
40392025-02-21T10:04:17.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb370639-bfc7-4446-8250-ea6335234472 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40402025-02-21T10:04:17.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb370639-bfc7-4446-8250-ea6335234472 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40412025-02-21T10:04:17.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb370639-bfc7-4446-8250-ea6335234472 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40422025-02-21T10:04:18.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1620aaab-d291-4403-acfc-aae63faaf48e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40432025-02-21T10:04:18.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1620aaab-d291-4403-acfc-aae63faaf48e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40442025-02-21T10:04:18.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1620aaab-d291-4403-acfc-aae63faaf48e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40452025-02-21T10:04:19.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 24d80e7c-8d00-410c-876d-38ad39d6aa89 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40462025-02-21T10:04:19.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 24d80e7c-8d00-410c-876d-38ad39d6aa89 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40472025-02-21T10:04:19.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 24d80e7c-8d00-410c-876d-38ad39d6aa89 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40482025-02-21T10:04:20.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6a500b98-aa6b-4af3-9fbf-9015bda1219f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40492025-02-21T10:04:20.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6a500b98-aa6b-4af3-9fbf-9015bda1219f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40502025-02-21T10:04:20.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2034 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6a500b98-aa6b-4af3-9fbf-9015bda1219f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40512025-02-21T10:04:21.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6f960480-378a-4fac-8bcb-9b918cd3436c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40522025-02-21T10:04:21.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6f960480-378a-4fac-8bcb-9b918cd3436c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40532025-02-21T10:04:21.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6f960480-378a-4fac-8bcb-9b918cd3436c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40542025-02-21T10:04:22.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8c7b9934-6166-45fb-b047-f31c3399fbc1 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40552025-02-21T10:04:22.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8c7b9934-6166-45fb-b047-f31c3399fbc1 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40562025-02-21T10:04:22.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8c7b9934-6166-45fb-b047-f31c3399fbc1 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40572025-02-21T10:04:23.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = f9263ee4-0219-4212-a9a4-2e09d7286c33 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
40582025-02-21T10:04:23.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = f9263ee4-0219-4212-a9a4-2e09d7286c33 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
40592025-02-21T10:04:23.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4270 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = f9263ee4-0219-4212-a9a4-2e09d7286c33 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
40602025-02-21T10:04:23.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 46b3071b-cb00-462e-9365-550dd31ea2aa roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40612025-02-21T10:04:23.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 46b3071b-cb00-462e-9365-550dd31ea2aa resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40622025-02-21T10:04:23.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1787 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 46b3071b-cb00-462e-9365-550dd31ea2aa response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
40632025-02-21T10:04:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
40642025-02-21T10:04:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40652025-02-21T10:04:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
40662025-02-21T10:04:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40672025-02-21T10:04:23.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
40682025-02-21T10:04:23.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40692025-02-21T10:04:23.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
40702025-02-21T10:04:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
40712025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40722025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
40732025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 13 reason = Timeout
40742025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
40752025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
40762025-02-21T10:04:23.559ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-21 09:54:23.559013351 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40772025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40782025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
40792025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40802025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
40812025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
40822025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40832025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40842025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
40852025-02-21T10:04:23.559ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041
40862025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.501\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041"}
40872025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
40882025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
40892025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
40902025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40912025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40922025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
40932025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40942025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
40952025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40962025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40972025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
40982025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
40992025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41002025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
41012025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41022025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
41032025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41042025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
41052025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41062025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
41072025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
41082025-02-21T10:04:23.559ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
41092025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41102025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
41112025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41122025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
41132025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41142025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
41152025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41162025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
41172025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
41182025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41192025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
41202025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41212025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
41222025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41232025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
41242025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
41252025-02-21T10:04:23.559ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41262025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
41272025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41282025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
41292025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41302025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41312025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41322025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41332025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41342025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
41352025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41362025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41372025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41382025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41392025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41402025-02-21T10:04:23.559ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3bf841e1-42b9-4bd7-ac20-7644b8a83464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1461, tv_nsec: 856719850 } })
41412025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41422025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41432025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41442025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41452025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41462025-02-21T10:04:23.559ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d154e9e-6d90-4040-b311-004f0e299e85.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e63432d-4205-48df-bd2b-03a054e87ab0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1461, tv_nsec: 856821472 } })
41472025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41482025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41492025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41502025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41512025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41522025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41532025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41542025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41552025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41562025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41572025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41582025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41592025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41602025-02-21T10:04:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41612025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41622025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
41632025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41642025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.111127ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
41652025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41662025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41672025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
41682025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.192929ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
41692025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41702025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41712025-02-21T10:04:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41722025-02-21T10:04:23.562ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.392532ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41732025-02-21T10:04:23.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41742025-02-21T10:04:23.563ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-21 09:54:23.559013351 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41752025-02-21T10:04:23.563ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.802766ms iteration = 7 status = {"expiration":"2025-02-21T09:54:23.559013351Z","pruned":[]}
41762025-02-21T10:04:23.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41772025-02-21T10:04:23.565ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1461, tv_nsec: 862263054 } })
41782025-02-21T10:04:23.565ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
41792025-02-21T10:04:23.565ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1461, tv_nsec: 863038953 } })
41802025-02-21T10:04:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41812025-02-21T10:04:23.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41822025-02-21T10:04:23.566ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41832025-02-21T10:04:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41842025-02-21T10:04:23.566ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
41852025-02-21T10:04:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41862025-02-21T10:04:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41872025-02-21T10:04:23.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41882025-02-21T10:04:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41892025-02-21T10:04:23.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902025-02-21T10:04:23.569ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41912025-02-21T10:04:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41922025-02-21T10:04:23.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41932025-02-21T10:04:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41942025-02-21T10:04:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41952025-02-21T10:04:23.571ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41962025-02-21T10:04:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41972025-02-21T10:04:23.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.962983ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
41982025-02-21T10:04:23.577ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41992025-02-21T10:04:23.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42002025-02-21T10:04:23.578ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.08957ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
42012025-02-21T10:04:23.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42022025-02-21T10:04:23.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42032025-02-21T10:04:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
42042025-02-21T10:04:23.581ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42052025-02-21T10:04:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42062025-02-21T10:04:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42072025-02-21T10:04:23.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42082025-02-21T10:04:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42092025-02-21T10:04:23.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42102025-02-21T10:04:23.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42112025-02-21T10:04:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42122025-02-21T10:04:23.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42132025-02-21T10:04:23.585ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42142025-02-21T10:04:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42152025-02-21T10:04:23.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42162025-02-21T10:04:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42172025-02-21T10:04:23.587ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42182025-02-21T10:04:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42192025-02-21T10:04:23.590ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42202025-02-21T10:04:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42212025-02-21T10:04:23.591ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42222025-02-21T10:04:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42232025-02-21T10:04:23.594ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42242025-02-21T10:04:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42252025-02-21T10:04:23.597ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42262025-02-21T10:04:23.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42272025-02-21T10:04:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42282025-02-21T10:04:23.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42292025-02-21T10:04:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42302025-02-21T10:04:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42312025-02-21T10:04:23.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42322025-02-21T10:04:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42332025-02-21T10:04:23.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42342025-02-21T10:04:23.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42352025-02-21T10:04:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42362025-02-21T10:04:23.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42372025-02-21T10:04:23.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42382025-02-21T10:04:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42392025-02-21T10:04:23.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42402025-02-21T10:04:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42412025-02-21T10:04:23.614ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42422025-02-21T10:04:23.614ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42432025-02-21T10:04:23.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42442025-02-21T10:04:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42452025-02-21T10:04:23.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42462025-02-21T10:04:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42472025-02-21T10:04:23.623ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42482025-02-21T10:04:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42492025-02-21T10:04:23.626ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42502025-02-21T10:04:23.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.866608ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
42512025-02-21T10:04:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42522025-02-21T10:04:23.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42532025-02-21T10:04:23.628ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42542025-02-21T10:04:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42552025-02-21T10:04:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42562025-02-21T10:04:23.629ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42572025-02-21T10:04:23.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42582025-02-21T10:04:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42592025-02-21T10:04:23.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42602025-02-21T10:04:23.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42612025-02-21T10:04:23.630ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42622025-02-21T10:04:23.630ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42632025-02-21T10:04:23.630ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.3037ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42642025-02-21T10:04:23.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42652025-02-21T10:04:23.632ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 73.713328ms iteration = 13 status = {"errors":[],"requests_created_ok":[]}
42662025-02-21T10:04:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42672025-02-21T10:04:23.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42682025-02-21T10:04:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42692025-02-21T10:04:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42702025-02-21T10:04:23.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42712025-02-21T10:04:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42722025-02-21T10:04:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42732025-02-21T10:04:23.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42742025-02-21T10:04:23.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42752025-02-21T10:04:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42762025-02-21T10:04:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42772025-02-21T10:04:23.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42782025-02-21T10:04:23.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42792025-02-21T10:04:23.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42802025-02-21T10:04:23.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42812025-02-21T10:04:23.639ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42822025-02-21T10:04:23.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.435825ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42832025-02-21T10:04:23.640ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 81.303852ms iteration = 4 status = {"nsuccess":5}
42842025-02-21T10:04:23.641ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42852025-02-21T10:04:23.641ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42862025-02-21T10:04:23.641ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.133872ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42872025-02-21T10:04:23.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42882025-02-21T10:04:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42892025-02-21T10:04:23.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42902025-02-21T10:04:23.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42912025-02-21T10:04:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42922025-02-21T10:04:23.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
42932025-02-21T10:04:23.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42942025-02-21T10:04:23.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42952025-02-21T10:04:23.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42962025-02-21T10:04:23.644ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1461, tv_nsec: 941842164 } })
42972025-02-21T10:04:23.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
42982025-02-21T10:04:23.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42992025-02-21T10:04:23.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43002025-02-21T10:04:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
43012025-02-21T10:04:23.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43022025-02-21T10:04:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43032025-02-21T10:04:23.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43042025-02-21T10:04:23.651ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43052025-02-21T10:04:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43062025-02-21T10:04:23.652ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43072025-02-21T10:04:23.652ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.366914ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43082025-02-21T10:04:23.653ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43092025-02-21T10:04:23.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43102025-02-21T10:04:23.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43112025-02-21T10:04:23.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43122025-02-21T10:04:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
43132025-02-21T10:04:23.655ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43142025-02-21T10:04:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43152025-02-21T10:04:23.658ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
43162025-02-21T10:04:23.658ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
43172025-02-21T10:04:23.658ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
43182025-02-21T10:04:23.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43192025-02-21T10:04:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43202025-02-21T10:04:23.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43212025-02-21T10:04:23.660ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
43222025-02-21T10:04:23.660ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
43232025-02-21T10:04:23.660ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
43242025-02-21T10:04:23.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43252025-02-21T10:04:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43262025-02-21T10:04:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43272025-02-21T10:04:23.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43282025-02-21T10:04:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43292025-02-21T10:04:23.664ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
43302025-02-21T10:04:23.664ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.529487ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
43312025-02-21T10:04:23.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43322025-02-21T10:04:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43332025-02-21T10:04:23.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 115.995009ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43342025-02-21T10:04:23.676ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43352025-02-21T10:04:23.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43362025-02-21T10:04:23.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 119.709899ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43372025-02-21T10:04:23.679ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43382025-02-21T10:04:23.679ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43392025-02-21T10:04:23.679ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43402025-02-21T10:04:23.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43412025-02-21T10:04:23.685ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43422025-02-21T10:04:23.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43432025-02-21T10:04:23.686ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
43442025-02-21T10:04:23.686ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 126.818241ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
43452025-02-21T10:04:23.715ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
43462025-02-21T10:04:23.715ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 156.232451ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43472025-02-21T10:04:23.721ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
43482025-02-21T10:04:23.721ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43492025-02-21T10:04:23.721ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fdae9a3-ebf1-408a-9f02-56e38d993b92", "content-length": "26", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
43502025-02-21T10:04:23.721ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43512025-02-21T10:04:23.722ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43522025-02-21T10:04:23.760ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.34286ms iteration = 15 status = {"physical_disks_added":0}
43532025-02-21T10:04:23.829ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
43542025-02-21T10:04:23.829ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43552025-02-21T10:04:23.829ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d10780c-fcee-4129-b284-5c15969bf56e", "content-length": "26", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
43562025-02-21T10:04:23.829ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43572025-02-21T10:04:23.831ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43582025-02-21T10:04:23.855ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43592025-02-21T10:04:23.855ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43602025-02-21T10:04:23.855ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "75547608-eb76-4a76-904f-ea6810f6f851", "content-length": "372", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
43612025-02-21T10:04:23.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43622025-02-21T10:04:23.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43632025-02-21T10:04:23.857ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43642025-02-21T10:04:23.857ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "30559f4a-455f-48c8-aafd-3cffd388e94f", "content-length": "691", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
43652025-02-21T10:04:23.857ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
43662025-02-21T10:04:23.857ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
43672025-02-21T10:04:23.857ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
43682025-02-21T10:04:23.859ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 300.309339ms iteration = 13 status = {}
43692025-02-21T10:04:23.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43702025-02-21T10:04:23.860ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43712025-02-21T10:04:23.860ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43722025-02-21T10:04:23.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43732025-02-21T10:04:23.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43742025-02-21T10:04:23.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43752025-02-21T10:04:23.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43762025-02-21T10:04:23.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43772025-02-21T10:04:23.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43782025-02-21T10:04:23.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43792025-02-21T10:04:23.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43802025-02-21T10:04:23.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43812025-02-21T10:04:23.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43822025-02-21T10:04:23.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43832025-02-21T10:04:23.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43842025-02-21T10:04:23.866ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43852025-02-21T10:04:23.866ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 0 version = 2
43862025-02-21T10:04:23.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43872025-02-21T10:04:23.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43882025-02-21T10:04:23.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
43892025-02-21T10:04:23.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43902025-02-21T10:04:23.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43912025-02-21T10:04:23.870ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 311.562831ms iteration = 13 status = 0
43922025-02-21T10:04:23.878ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43932025-02-21T10:04:23.878ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43942025-02-21T10:04:23.892ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43952025-02-21T10:04:23.892ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43962025-02-21T10:04:23.892ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 333.549792ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43972025-02-21T10:04:23.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 336.005621ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
43982025-02-21T10:04:23.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43992025-02-21T10:04:23.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44002025-02-21T10:04:23.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44012025-02-21T10:04:23.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44022025-02-21T10:04:23.901ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
44032025-02-21T10:04:23.901ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
44042025-02-21T10:04:23.901ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-21 09:58:29.164998 UTC dns_group = internal generation = 1
44052025-02-21T10:04:23.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 342.208971ms iteration = 7 status = {"generation":1}
44062025-02-21T10:04:23.904ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-21T09:58:18.895783Z, time_modified: 2025-02-21T09:58:18.895783Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }) }
44072025-02-21T10:04:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 345.216593ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]}},"default_endpoint":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44082025-02-21T10:04:23.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44092025-02-21T10:04:23.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44102025-02-21T10:04:23.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44112025-02-21T10:04:23.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44122025-02-21T10:04:23.910ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 1 version = 2
44132025-02-21T10:04:23.910ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
44142025-02-21T10:04:23.910ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-21 09:58:29.727106 UTC dns_group = external generation = 2
44152025-02-21T10:04:23.910ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 351.157977ms iteration = 7 status = {"generation":2}
44162025-02-21T10:04:23.910ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
44172025-02-21T10:04:23.910ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44182025-02-21T10:04:23.911ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "82ab7435-1e6d-4b55-b483-5286fdf16a92", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
44192025-02-21T10:04:23.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44202025-02-21T10:04:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44212025-02-21T10:04:23.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44222025-02-21T10:04:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44232025-02-21T10:04:23.915ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44242025-02-21T10:04:23.915ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "931a2a01-aaa4-4d93-9d43-6bde723d0eed", "content-length": "1", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
44252025-02-21T10:04:23.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44262025-02-21T10:04:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44272025-02-21T10:04:23.917ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44282025-02-21T10:04:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44292025-02-21T10:04:23.919ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 360.225265ms iteration = 13 status = null
44302025-02-21T10:04:23.919ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44312025-02-21T10:04:23.919ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44322025-02-21T10:04:23.920ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5254e7e0-3942-4c0c-bfa6-122368078529", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
44332025-02-21T10:04:23.922ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 362.907561ms iteration = 13 status = {}
44342025-02-21T10:04:23.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
44352025-02-21T10:04:23.979ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44362025-02-21T10:04:23.979ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0035b59-51e1-43a6-975b-089881e0532b", "content-length": "26", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
44372025-02-21T10:04:23.979ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44382025-02-21T10:04:23.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
44392025-02-21T10:04:24.040ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 481.052103ms iteration = 13 status = {}
44402025-02-21T10:04:24.114ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44412025-02-21T10:04:24.114ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5857d18b-889e-45bb-8c82-ebdf9d148621", "date": "Fri, 21 Feb 2025 10:04:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44422025-02-21T10:04:24.114ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44432025-02-21T10:04:24.116ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3a8e7720-2602-40c7-b171-32dae6343ede", "date": "Fri, 21 Feb 2025 10:04:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44442025-02-21T10:04:24.116ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44452025-02-21T10:04:24.118ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44462025-02-21T10:04:24.118ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44472025-02-21T10:04:24.118ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 559.65296ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44482025-02-21T10:04:24.132ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
44492025-02-21T10:04:24.132ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
44502025-02-21T10:04:24.208ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
44512025-02-21T10:04:24.208ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "77f121e8-a155-49e6-ac29-5f7872ed1f5f", "date": "Fri, 21 Feb 2025 10:04:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44522025-02-21T10:04:24.208ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44532025-02-21T10:04:24.209ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "19ce473f-9add-4d40-b230-868e75c7277e", "date": "Fri, 21 Feb 2025 10:04:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44542025-02-21T10:04:24.209ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44552025-02-21T10:04:24.211ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1c1508df-5fb1-4937-8b88-7a45d3e11c84", "date": "Fri, 21 Feb 2025 10:04:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44562025-02-21T10:04:24.211ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44572025-02-21T10:04:24.213ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
44582025-02-21T10:04:24.213ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 654.12048ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
44592025-02-21T10:04:24.216ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
44602025-02-21T10:04:24.216ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:38385
44612025-02-21T10:04:24.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:38385 req_id = 65525e09-98d6-4bbd-a793-1879d0686718 roles = RoleSet { roles: {} } uri = /metrics/producers
44622025-02-21T10:04:24.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:38385 req_id = 65525e09-98d6-4bbd-a793-1879d0686718 resource = Database result = Ok(()) uri = /metrics/producers
44632025-02-21T10:04:24.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44642025-02-21T10:04:24.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44652025-02-21T10:04:24.234ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
44662025-02-21T10:04:24.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44672025-02-21T10:04:24.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44682025-02-21T10:04:24.247ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44692025-02-21T10:04:24.247ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee26c08c-9df6-4514-b077-93657e1a9edb", "content-length": "134", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
44702025-02-21T10:04:24.247ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44712025-02-21T10:04:24.247ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
44722025-02-21T10:04:24.247ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44732025-02-21T10:04:24.247ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44742025-02-21T10:04:24.247ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44752025-02-21T10:04:24.247ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44762025-02-21T10:04:24.247ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44772025-02-21T10:04:24.247ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44782025-02-21T10:04:24.247ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44792025-02-21T10:04:24.247ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44802025-02-21T10:04:24.248ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
44812025-02-21T10:04:24.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44822025-02-21T10:04:24.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44832025-02-21T10:04:24.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9a3829db-29aa-4336-b891-8cf0feaa7e05 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
44842025-02-21T10:04:24.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9a3829db-29aa-4336-b891-8cf0feaa7e05 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
44852025-02-21T10:04:24.250ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44862025-02-21T10:04:24.250ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a758be2-50e7-4f72-b4f2-e2532e278524", "content-length": "2", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
44872025-02-21T10:04:24.250ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44882025-02-21T10:04:24.250ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "17efb1cd-4275-4ca6-ac9d-b82a3635cd06", "content-length": "52", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
44892025-02-21T10:04:24.250ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
44902025-02-21T10:04:24.250ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44912025-02-21T10:04:24.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9a3829db-29aa-4336-b891-8cf0feaa7e05 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
44922025-02-21T10:04:24.268ZINFOnexus: assigned collector to new producer collector_id = 8d248760-b8d2-4503-94cf-92f282d79332 file = nexus/src/app/oximeter.rs:76 producer_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
44932025-02-21T10:04:24.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 51894 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:38385 req_id = 65525e09-98d6-4bbd-a793-1879d0686718 response_code = 201 uri = /metrics/producers
44942025-02-21T10:04:24.268ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "65525e09-98d6-4bbd-a793-1879d0686718", "content-length": "41", "date": "Fri, 21 Feb 2025 10:04:24 GMT"} })
44952025-02-21T10:04:24.269ZDEBGnexus (producer-registration-task): registered with nexus successfully
44962025-02-21T10:04:24.269ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
44972025-02-21T10:04:24.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c104a941-7901-44fb-b6a8-5e1dcbaea0f4", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
44982025-02-21T10:04:24.349ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
44992025-02-21T10:04:24.349ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45002025-02-21T10:04:24.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "621f0c0e-5d0f-4811-830e-937e26731adc", "content-length": "682", "date": "Fri, 21 Feb 2025 10:04:23 GMT"} })
45012025-02-21T10:04:24.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45022025-02-21T10:04:24.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45032025-02-21T10:04:24.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45042025-02-21T10:04:24.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45052025-02-21T10:04:24.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45062025-02-21T10:04:24.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45072025-02-21T10:04:24.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45082025-02-21T10:04:24.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45092025-02-21T10:04:24.366ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 807.129214ms iteration = 13 status = {}
45102025-02-21T10:04:25.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8aa268fb-0f8c-4174-975f-f02b445c6967 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45112025-02-21T10:04:25.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8aa268fb-0f8c-4174-975f-f02b445c6967 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45122025-02-21T10:04:25.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8aa268fb-0f8c-4174-975f-f02b445c6967 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45132025-02-21T10:04:26.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b63cb693-161f-440d-b52c-33370336878c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45142025-02-21T10:04:26.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b63cb693-161f-440d-b52c-33370336878c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45152025-02-21T10:04:26.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2686 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b63cb693-161f-440d-b52c-33370336878c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45162025-02-21T10:04:26.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 650 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 05e0f79e-6707-4952-8061-9ba8b3a6ace9 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
45172025-02-21T10:04:27.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb0b64b8-12f2-4f53-b937-1e0b69f7ec16 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45182025-02-21T10:04:27.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb0b64b8-12f2-4f53-b937-1e0b69f7ec16 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45192025-02-21T10:04:27.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2675 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb0b64b8-12f2-4f53-b937-1e0b69f7ec16 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45202025-02-21T10:04:28.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 795b4f20-78f7-4d34-ba8f-2d1ddb31b4d7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45212025-02-21T10:04:28.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 795b4f20-78f7-4d34-ba8f-2d1ddb31b4d7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45222025-02-21T10:04:28.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2631 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 795b4f20-78f7-4d34-ba8f-2d1ddb31b4d7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45232025-02-21T10:04:29.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a586213b-727e-45fe-b63a-8f3a8f820609 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45242025-02-21T10:04:29.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a586213b-727e-45fe-b63a-8f3a8f820609 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45252025-02-21T10:04:29.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2849 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a586213b-727e-45fe-b63a-8f3a8f820609 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45262025-02-21T10:04:30.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f39d46dd-1636-4d43-b1f6-cdc44e2c687b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45272025-02-21T10:04:30.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f39d46dd-1636-4d43-b1f6-cdc44e2c687b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45282025-02-21T10:04:30.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1841 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f39d46dd-1636-4d43-b1f6-cdc44e2c687b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45292025-02-21T10:04:31.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f2464c28-c3dc-4533-a9a8-49c06c9fe84a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45302025-02-21T10:04:31.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f2464c28-c3dc-4533-a9a8-49c06c9fe84a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45312025-02-21T10:04:31.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f2464c28-c3dc-4533-a9a8-49c06c9fe84a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45322025-02-21T10:04:32.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = da330c2c-75e3-4f6c-bdcd-036ae5e93755 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45332025-02-21T10:04:32.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = da330c2c-75e3-4f6c-bdcd-036ae5e93755 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45342025-02-21T10:04:32.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = da330c2c-75e3-4f6c-bdcd-036ae5e93755 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45352025-02-21T10:04:33.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9c87a1d1-d313-4f07-849c-056030e4f072 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45362025-02-21T10:04:33.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9c87a1d1-d313-4f07-849c-056030e4f072 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45372025-02-21T10:04:33.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9c87a1d1-d313-4f07-849c-056030e4f072 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45382025-02-21T10:04:33.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
45392025-02-21T10:04:33.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45402025-02-21T10:04:33.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
45412025-02-21T10:04:33.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45422025-02-21T10:04:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45432025-02-21T10:04:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45442025-02-21T10:04:33.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45452025-02-21T10:04:33.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45462025-02-21T10:04:33.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45472025-02-21T10:04:33.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45482025-02-21T10:04:33.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45492025-02-21T10:04:33.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45502025-02-21T10:04:33.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45512025-02-21T10:04:33.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45522025-02-21T10:04:33.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45532025-02-21T10:04:33.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
45542025-02-21T10:04:33.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45552025-02-21T10:04:33.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45562025-02-21T10:04:33.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.662431ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45572025-02-21T10:04:33.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
45582025-02-21T10:04:33.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.001878ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
45592025-02-21T10:04:34.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 27082ce5-eb56-4153-b13e-b951e8b1a537 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45602025-02-21T10:04:34.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 27082ce5-eb56-4153-b13e-b951e8b1a537 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45612025-02-21T10:04:34.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1910 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 27082ce5-eb56-4153-b13e-b951e8b1a537 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45622025-02-21T10:04:35.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2acee9ab-6069-4b53-9bde-b55a51739869 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45632025-02-21T10:04:35.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2acee9ab-6069-4b53-9bde-b55a51739869 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45642025-02-21T10:04:35.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2acee9ab-6069-4b53-9bde-b55a51739869 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45652025-02-21T10:04:36.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = f2c9284e-73d9-42aa-b3e1-283b131b8275 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
45662025-02-21T10:04:36.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0b108f71-1451-40e6-828a-1cdd0562b129 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45672025-02-21T10:04:36.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0b108f71-1451-40e6-828a-1cdd0562b129 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45682025-02-21T10:04:36.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0b108f71-1451-40e6-828a-1cdd0562b129 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45692025-02-21T10:04:37.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 08620014-45cc-4d04-9c48-479de9edc717 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45702025-02-21T10:04:37.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 08620014-45cc-4d04-9c48-479de9edc717 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45712025-02-21T10:04:37.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2466 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 08620014-45cc-4d04-9c48-479de9edc717 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45722025-02-21T10:04:38.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 048c0ebb-809a-4972-91a4-9b1e3ade3b17 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45732025-02-21T10:04:38.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 048c0ebb-809a-4972-91a4-9b1e3ade3b17 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45742025-02-21T10:04:38.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 048c0ebb-809a-4972-91a4-9b1e3ade3b17 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45752025-02-21T10:04:39.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8a8aacc4-5b34-495b-833b-ea26c41409c0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45762025-02-21T10:04:39.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8a8aacc4-5b34-495b-833b-ea26c41409c0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45772025-02-21T10:04:39.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8a8aacc4-5b34-495b-833b-ea26c41409c0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45782025-02-21T10:04:40.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 60422f20-7393-41e4-b4c8-dc293c1ea8c5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45792025-02-21T10:04:40.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 60422f20-7393-41e4-b4c8-dc293c1ea8c5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45802025-02-21T10:04:40.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1859 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 60422f20-7393-41e4-b4c8-dc293c1ea8c5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45812025-02-21T10:04:41.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d9d6844a-f698-48f2-9e28-c30f07db1df1 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45822025-02-21T10:04:41.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d9d6844a-f698-48f2-9e28-c30f07db1df1 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45832025-02-21T10:04:41.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d9d6844a-f698-48f2-9e28-c30f07db1df1 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45842025-02-21T10:04:42.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8ec76ed6-b8b6-436f-ae53-7a9e726e271b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45852025-02-21T10:04:42.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8ec76ed6-b8b6-436f-ae53-7a9e726e271b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45862025-02-21T10:04:42.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8ec76ed6-b8b6-436f-ae53-7a9e726e271b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
45872025-02-21T10:04:43.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
45882025-02-21T10:04:43.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45892025-02-21T10:04:43.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
45902025-02-21T10:04:43.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45912025-02-21T10:04:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45922025-02-21T10:04:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45932025-02-21T10:04:43.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45942025-02-21T10:04:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45952025-02-21T10:04:43.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45962025-02-21T10:04:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45972025-02-21T10:04:43.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45982025-02-21T10:04:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45992025-02-21T10:04:43.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46002025-02-21T10:04:43.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46012025-02-21T10:04:43.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46022025-02-21T10:04:43.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
46032025-02-21T10:04:43.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46042025-02-21T10:04:43.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46052025-02-21T10:04:43.579ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
46062025-02-21T10:04:43.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.519495ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
46072025-02-21T10:04:43.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.386998ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46082025-02-21T10:04:43.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ab3646b8-1767-4202-b57d-00337f8be721 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46092025-02-21T10:04:43.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ab3646b8-1767-4202-b57d-00337f8be721 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46102025-02-21T10:04:43.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1428 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ab3646b8-1767-4202-b57d-00337f8be721 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46112025-02-21T10:04:44.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c46ee21-1b41-4aa0-98ae-82cd7c7ab8e7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46122025-02-21T10:04:44.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c46ee21-1b41-4aa0-98ae-82cd7c7ab8e7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46132025-02-21T10:04:44.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2647 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c46ee21-1b41-4aa0-98ae-82cd7c7ab8e7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46142025-02-21T10:04:45.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 21c49487-468f-410c-a4ce-9fde322dcecb roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46152025-02-21T10:04:45.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 21c49487-468f-410c-a4ce-9fde322dcecb resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46162025-02-21T10:04:45.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 21c49487-468f-410c-a4ce-9fde322dcecb response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46172025-02-21T10:04:46.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = a09a593b-b690-43b4-b11f-1b53c2f2b39e response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
46182025-02-21T10:04:46.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = be3dfca1-c100-4f3b-a004-4ba765bbad72 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46192025-02-21T10:04:46.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = be3dfca1-c100-4f3b-a004-4ba765bbad72 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46202025-02-21T10:04:46.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2489 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = be3dfca1-c100-4f3b-a004-4ba765bbad72 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46212025-02-21T10:04:47.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ce533011-ccb8-4a4f-9565-d4ef05542e31 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46222025-02-21T10:04:47.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ce533011-ccb8-4a4f-9565-d4ef05542e31 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46232025-02-21T10:04:47.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ce533011-ccb8-4a4f-9565-d4ef05542e31 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46242025-02-21T10:04:48.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff126147-36b0-4bc3-9476-5e6695877073 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46252025-02-21T10:04:48.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff126147-36b0-4bc3-9476-5e6695877073 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46262025-02-21T10:04:48.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff126147-36b0-4bc3-9476-5e6695877073 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46272025-02-21T10:04:49.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d676b8cb-2528-469c-81d7-b1b537736c71 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46282025-02-21T10:04:49.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d676b8cb-2528-469c-81d7-b1b537736c71 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46292025-02-21T10:04:49.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d676b8cb-2528-469c-81d7-b1b537736c71 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46302025-02-21T10:04:50.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cf2711f2-5b72-4026-98f4-86daafbaee64 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46312025-02-21T10:04:50.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cf2711f2-5b72-4026-98f4-86daafbaee64 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46322025-02-21T10:04:50.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cf2711f2-5b72-4026-98f4-86daafbaee64 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46332025-02-21T10:04:51.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 90329191-2de9-435d-89b3-93e61c4e2a61 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46342025-02-21T10:04:51.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 90329191-2de9-435d-89b3-93e61c4e2a61 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46352025-02-21T10:04:51.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 90329191-2de9-435d-89b3-93e61c4e2a61 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46362025-02-21T10:04:52.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 18926279-ab54-46ac-b07f-1d5b2e80e5b9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46372025-02-21T10:04:52.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 18926279-ab54-46ac-b07f-1d5b2e80e5b9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46382025-02-21T10:04:52.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 18926279-ab54-46ac-b07f-1d5b2e80e5b9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
46392025-02-21T10:04:53.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 1b4383fc-e8d4-4c9b-b759-6d7248c598a6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46402025-02-21T10:04:53.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 1b4383fc-e8d4-4c9b-b759-6d7248c598a6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46412025-02-21T10:04:53.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2941 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 1b4383fc-e8d4-4c9b-b759-6d7248c598a6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46422025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
46432025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46442025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
46452025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
46462025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
46472025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46482025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
46492025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
46502025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46512025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46522025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
46532025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
46542025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46552025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
46562025-02-21T10:04:53.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46572025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46582025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
46592025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46602025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46612025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
46622025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46632025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
46642025-02-21T10:04:53.559ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46652025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46662025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
46672025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46682025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
46692025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46702025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
46712025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
46722025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46732025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46742025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
46752025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46762025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
46772025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
46782025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46792025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
46802025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46812025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46822025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
46832025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46842025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46852025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46862025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46872025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46882025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46892025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46902025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46912025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46922025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46932025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46942025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46952025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46962025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46972025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46982025-02-21T10:04:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46992025-02-21T10:04:53.562ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.227898ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47002025-02-21T10:04:53.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47012025-02-21T10:04:53.564ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1491, tv_nsec: 861254729 } })
47022025-02-21T10:04:53.564ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
47032025-02-21T10:04:53.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47042025-02-21T10:04:53.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47052025-02-21T10:04:53.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47062025-02-21T10:04:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47072025-02-21T10:04:53.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47082025-02-21T10:04:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47092025-02-21T10:04:53.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47102025-02-21T10:04:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47112025-02-21T10:04:53.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47122025-02-21T10:04:53.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47132025-02-21T10:04:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47142025-02-21T10:04:53.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47152025-02-21T10:04:53.576ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1491, tv_nsec: 873805992 } })
47162025-02-21T10:04:53.576ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
47172025-02-21T10:04:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47182025-02-21T10:04:53.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47192025-02-21T10:04:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47202025-02-21T10:04:53.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47212025-02-21T10:04:53.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47222025-02-21T10:04:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47232025-02-21T10:04:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47242025-02-21T10:04:53.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47252025-02-21T10:04:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47262025-02-21T10:04:53.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.002988ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
47272025-02-21T10:04:53.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47282025-02-21T10:04:53.608ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 49.881903ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
47292025-02-21T10:04:53.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47302025-02-21T10:04:53.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47312025-02-21T10:04:53.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47322025-02-21T10:04:53.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.846305ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
47332025-02-21T10:04:53.612ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47342025-02-21T10:04:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47352025-02-21T10:04:53.615ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47362025-02-21T10:04:53.616ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47372025-02-21T10:04:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47382025-02-21T10:04:53.617ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47392025-02-21T10:04:53.617ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47402025-02-21T10:04:53.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47412025-02-21T10:04:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47422025-02-21T10:04:53.617ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47432025-02-21T10:04:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47442025-02-21T10:04:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47452025-02-21T10:04:53.617ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47462025-02-21T10:04:53.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47472025-02-21T10:04:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47482025-02-21T10:04:53.617ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47492025-02-21T10:04:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47502025-02-21T10:04:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47512025-02-21T10:04:53.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47522025-02-21T10:04:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47532025-02-21T10:04:53.620ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
47542025-02-21T10:04:53.620ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47552025-02-21T10:04:53.620ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb59cb17-3c23-436d-9f3c-e7b318d8e702", "content-length": "26", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
47562025-02-21T10:04:53.621ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47572025-02-21T10:04:53.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.56461ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47582025-02-21T10:04:53.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47592025-02-21T10:04:53.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47602025-02-21T10:04:53.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.202326ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47612025-02-21T10:04:53.623ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47622025-02-21T10:04:53.623ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1491, tv_nsec: 921024292 } })
47632025-02-21T10:04:53.624ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
47642025-02-21T10:04:53.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47652025-02-21T10:04:53.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47662025-02-21T10:04:53.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47672025-02-21T10:04:53.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47682025-02-21T10:04:53.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47692025-02-21T10:04:53.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47702025-02-21T10:04:53.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47712025-02-21T10:04:53.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
47722025-02-21T10:04:53.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47732025-02-21T10:04:53.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47742025-02-21T10:04:53.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47752025-02-21T10:04:53.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47762025-02-21T10:04:53.630ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.437584ms iteration = 14 status = 0
47772025-02-21T10:04:53.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
47782025-02-21T10:04:53.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47792025-02-21T10:04:53.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47802025-02-21T10:04:53.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47812025-02-21T10:04:53.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47822025-02-21T10:04:53.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47832025-02-21T10:04:53.649ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
47842025-02-21T10:04:53.649ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.702999ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
47852025-02-21T10:04:53.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.300871ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47862025-02-21T10:04:53.654ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47872025-02-21T10:04:53.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.540086ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47882025-02-21T10:04:53.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47892025-02-21T10:04:53.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47902025-02-21T10:04:53.656ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47912025-02-21T10:04:53.656ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47922025-02-21T10:04:53.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47932025-02-21T10:04:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47942025-02-21T10:04:53.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.373944ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
47952025-02-21T10:04:53.657ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47962025-02-21T10:04:53.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47972025-02-21T10:04:53.659ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47982025-02-21T10:04:53.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47992025-02-21T10:04:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48002025-02-21T10:04:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
48012025-02-21T10:04:53.660ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48022025-02-21T10:04:53.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
48032025-02-21T10:04:53.685ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
48042025-02-21T10:04:53.685ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48052025-02-21T10:04:53.685ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25af0486-238a-4b62-96d5-cfe7d6f2a810", "content-length": "26", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48062025-02-21T10:04:53.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48072025-02-21T10:04:53.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48082025-02-21T10:04:53.693ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48092025-02-21T10:04:53.693ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48102025-02-21T10:04:53.693ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.479816ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48112025-02-21T10:04:53.695ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
48122025-02-21T10:04:53.695ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 137.080469ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
48132025-02-21T10:04:53.729ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
48142025-02-21T10:04:53.729ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48152025-02-21T10:04:53.729ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3afb1ab0-7e6f-461f-8ef5-158225f6bfef", "content-length": "26", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48162025-02-21T10:04:53.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48172025-02-21T10:04:53.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
48182025-02-21T10:04:53.733ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.170078ms iteration = 16 status = {"physical_disks_added":0}
48192025-02-21T10:04:53.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48202025-02-21T10:04:53.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48212025-02-21T10:04:53.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48222025-02-21T10:04:53.757ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48232025-02-21T10:04:53.757ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48242025-02-21T10:04:53.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48252025-02-21T10:04:53.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48262025-02-21T10:04:53.758ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb85c807-6e70-49aa-9f4d-f08fa91241f6", "content-length": "1", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48272025-02-21T10:04:53.760ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48282025-02-21T10:04:53.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48292025-02-21T10:04:53.788ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 229.435898ms iteration = 14 status = {}
48302025-02-21T10:04:53.794ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48312025-02-21T10:04:53.794ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48322025-02-21T10:04:53.794ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5a1db93-e128-41f7-ace8-d5c1b27cc138", "content-length": "372", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48332025-02-21T10:04:53.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48342025-02-21T10:04:53.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48352025-02-21T10:04:53.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48362025-02-21T10:04:53.797ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 238.563209ms iteration = 14 status = null
48372025-02-21T10:04:53.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48382025-02-21T10:04:53.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48392025-02-21T10:04:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48402025-02-21T10:04:53.809ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
48412025-02-21T10:04:53.809ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48422025-02-21T10:04:53.810ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d31c7461-48e3-4e4a-9e50-8e09395da546", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48432025-02-21T10:04:53.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48442025-02-21T10:04:53.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48452025-02-21T10:04:53.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48462025-02-21T10:04:53.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48472025-02-21T10:04:53.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48482025-02-21T10:04:53.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48492025-02-21T10:04:53.818ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48502025-02-21T10:04:53.818ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48512025-02-21T10:04:53.818ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3af62057-78dd-44b0-b57e-0d4dcc319565", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48522025-02-21T10:04:53.820ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 261.372699ms iteration = 14 status = {}
48532025-02-21T10:04:53.856ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48542025-02-21T10:04:53.856ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e9e9f0d-d20e-43b9-9bb4-e4aecb2bcc85", "content-length": "691", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48552025-02-21T10:04:53.856ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
48562025-02-21T10:04:53.856ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
48572025-02-21T10:04:53.856ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
48582025-02-21T10:04:53.858ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 299.722615ms iteration = 14 status = {}
48592025-02-21T10:04:53.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48602025-02-21T10:04:53.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48612025-02-21T10:04:53.897ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
48622025-02-21T10:04:53.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48632025-02-21T10:04:53.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48642025-02-21T10:04:53.907ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48652025-02-21T10:04:53.908ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "96d70e85-b271-4ee3-9b15-6b0912c3c4a3", "content-length": "134", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48662025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48672025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
48682025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48692025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48702025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48712025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48722025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48732025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48742025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48752025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48762025-02-21T10:04:53.908ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
48772025-02-21T10:04:53.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48782025-02-21T10:04:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48792025-02-21T10:04:53.911ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48802025-02-21T10:04:53.911ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "70426067-cfa9-4a7c-a8fd-aa3dbb74243b", "content-length": "2", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48812025-02-21T10:04:53.911ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48822025-02-21T10:04:53.911ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ec24384-7787-43e5-9034-c976f6fff5cb", "content-length": "52", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48832025-02-21T10:04:53.911ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
48842025-02-21T10:04:53.911ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48852025-02-21T10:04:54.015ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "210255aa-02da-4c9d-8b1e-c3f891d0890e", "date": "Fri, 21 Feb 2025 10:04:53 GMT"} })
48862025-02-21T10:04:54.015ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
48872025-02-21T10:04:54.015ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48882025-02-21T10:04:54.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = db65ecff-c88b-4878-9328-85922e966d1b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
48892025-02-21T10:04:54.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = db65ecff-c88b-4878-9328-85922e966d1b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
48902025-02-21T10:04:54.016ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fea15c9a-a3a6-433b-89ba-ca22b0776850", "content-length": "682", "date": "Fri, 21 Feb 2025 10:04:54 GMT"} })
48912025-02-21T10:04:54.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48922025-02-21T10:04:54.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48932025-02-21T10:04:54.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = db65ecff-c88b-4878-9328-85922e966d1b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
48942025-02-21T10:04:54.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48952025-02-21T10:04:54.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48962025-02-21T10:04:54.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48972025-02-21T10:04:54.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48982025-02-21T10:04:54.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48992025-02-21T10:04:54.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49002025-02-21T10:04:54.034ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 475.329584ms iteration = 14 status = {}
49012025-02-21T10:04:55.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4a4a9695-ab1f-4161-9ce4-3e49eeaad415 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49022025-02-21T10:04:55.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4a4a9695-ab1f-4161-9ce4-3e49eeaad415 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49032025-02-21T10:04:55.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4a4a9695-ab1f-4161-9ce4-3e49eeaad415 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49042025-02-21T10:04:56.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ca6095a1-fede-4786-9925-ee802648f1b0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49052025-02-21T10:04:56.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ca6095a1-fede-4786-9925-ee802648f1b0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49062025-02-21T10:04:56.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ca6095a1-fede-4786-9925-ee802648f1b0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49072025-02-21T10:04:56.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 584 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = b7c6a18f-4818-4795-a286-1fac2260bfe1 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
49082025-02-21T10:04:57.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 051263b9-1a46-43c8-92a8-c0ce56c1bb42 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49092025-02-21T10:04:57.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 051263b9-1a46-43c8-92a8-c0ce56c1bb42 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49102025-02-21T10:04:57.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 051263b9-1a46-43c8-92a8-c0ce56c1bb42 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49112025-02-21T10:04:58.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0a307cef-513a-40dd-85bd-b5951f882a9b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49122025-02-21T10:04:58.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0a307cef-513a-40dd-85bd-b5951f882a9b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49132025-02-21T10:04:58.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0a307cef-513a-40dd-85bd-b5951f882a9b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49142025-02-21T10:04:59.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5983f132-4be1-4f2b-bbe9-ffc2ef725b6a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49152025-02-21T10:04:59.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5983f132-4be1-4f2b-bbe9-ffc2ef725b6a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49162025-02-21T10:04:59.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1807 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5983f132-4be1-4f2b-bbe9-ffc2ef725b6a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49172025-02-21T10:05:00.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5cb84c0c-51cb-4f6b-8ebe-fab13edb06c5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49182025-02-21T10:05:00.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5cb84c0c-51cb-4f6b-8ebe-fab13edb06c5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49192025-02-21T10:05:00.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5cb84c0c-51cb-4f6b-8ebe-fab13edb06c5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49202025-02-21T10:05:01.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6843e750-7aad-442d-a2fb-b5ac1fd0f4d8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49212025-02-21T10:05:01.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6843e750-7aad-442d-a2fb-b5ac1fd0f4d8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49222025-02-21T10:05:01.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2750 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6843e750-7aad-442d-a2fb-b5ac1fd0f4d8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49232025-02-21T10:05:02.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 76c5b06e-74b1-431a-b2d6-08590606a992 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49242025-02-21T10:05:02.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 76c5b06e-74b1-431a-b2d6-08590606a992 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49252025-02-21T10:05:02.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 76c5b06e-74b1-431a-b2d6-08590606a992 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49262025-02-21T10:05:03.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a64f8baf-4820-4d30-a3a2-23a2c010a811 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49272025-02-21T10:05:03.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a64f8baf-4820-4d30-a3a2-23a2c010a811 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49282025-02-21T10:05:03.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a64f8baf-4820-4d30-a3a2-23a2c010a811 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49292025-02-21T10:05:03.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
49302025-02-21T10:05:03.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49312025-02-21T10:05:03.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
49322025-02-21T10:05:03.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49332025-02-21T10:05:03.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49342025-02-21T10:05:03.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49352025-02-21T10:05:03.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49362025-02-21T10:05:03.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49372025-02-21T10:05:03.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49382025-02-21T10:05:03.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49392025-02-21T10:05:03.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49402025-02-21T10:05:03.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49412025-02-21T10:05:03.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49422025-02-21T10:05:03.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
49432025-02-21T10:05:03.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49442025-02-21T10:05:03.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49452025-02-21T10:05:03.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
49462025-02-21T10:05:03.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.666704ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
49472025-02-21T10:05:03.588ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49482025-02-21T10:05:03.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49492025-02-21T10:05:03.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.532117ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49502025-02-21T10:05:04.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 742b5218-4395-4fe7-8113-d1fbca0d5eac roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49512025-02-21T10:05:04.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 742b5218-4395-4fe7-8113-d1fbca0d5eac resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49522025-02-21T10:05:04.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 742b5218-4395-4fe7-8113-d1fbca0d5eac response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49532025-02-21T10:05:05.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c271549-4aea-4149-a69d-d7381bb67d1e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49542025-02-21T10:05:05.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c271549-4aea-4149-a69d-d7381bb67d1e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49552025-02-21T10:05:05.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c271549-4aea-4149-a69d-d7381bb67d1e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49562025-02-21T10:05:06.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b1f1150a-75d1-4253-9c9b-bd083805ffd8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49572025-02-21T10:05:06.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b1f1150a-75d1-4253-9c9b-bd083805ffd8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49582025-02-21T10:05:06.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b1f1150a-75d1-4253-9c9b-bd083805ffd8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49592025-02-21T10:05:06.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 491 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = ec4f0ae6-7542-4de0-823d-137042d3c755 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
49602025-02-21T10:05:07.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 54a3db81-7d0d-40ec-85ac-891626f3db66 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49612025-02-21T10:05:07.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 54a3db81-7d0d-40ec-85ac-891626f3db66 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49622025-02-21T10:05:07.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 54a3db81-7d0d-40ec-85ac-891626f3db66 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49632025-02-21T10:05:08.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ad4e1877-c591-46fc-9e68-ac9d6ee94da7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49642025-02-21T10:05:08.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ad4e1877-c591-46fc-9e68-ac9d6ee94da7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49652025-02-21T10:05:08.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ad4e1877-c591-46fc-9e68-ac9d6ee94da7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49662025-02-21T10:05:09.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ccb37801-0e05-4eaf-9cfa-45befbd632cd roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49672025-02-21T10:05:09.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ccb37801-0e05-4eaf-9cfa-45befbd632cd resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49682025-02-21T10:05:09.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2052 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ccb37801-0e05-4eaf-9cfa-45befbd632cd response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49692025-02-21T10:05:10.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3b506cbb-07fe-4e05-8b5f-bd7246d1b1f7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49702025-02-21T10:05:10.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3b506cbb-07fe-4e05-8b5f-bd7246d1b1f7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49712025-02-21T10:05:10.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3b506cbb-07fe-4e05-8b5f-bd7246d1b1f7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49722025-02-21T10:05:11.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d0e4bd32-09b0-4efc-a149-f19920b7a014 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49732025-02-21T10:05:11.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d0e4bd32-09b0-4efc-a149-f19920b7a014 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49742025-02-21T10:05:11.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d0e4bd32-09b0-4efc-a149-f19920b7a014 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49752025-02-21T10:05:12.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fb705457-0727-4991-9d2b-7194ba766428 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49762025-02-21T10:05:12.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fb705457-0727-4991-9d2b-7194ba766428 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49772025-02-21T10:05:12.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fb705457-0727-4991-9d2b-7194ba766428 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49782025-02-21T10:05:13.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 06507cf1-2b10-4d91-a8d6-26b334ef5d32 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49792025-02-21T10:05:13.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 06507cf1-2b10-4d91-a8d6-26b334ef5d32 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49802025-02-21T10:05:13.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1979 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 06507cf1-2b10-4d91-a8d6-26b334ef5d32 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
49812025-02-21T10:05:13.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
49822025-02-21T10:05:13.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
49832025-02-21T10:05:13.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49842025-02-21T10:05:13.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49852025-02-21T10:05:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49862025-02-21T10:05:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49872025-02-21T10:05:13.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49882025-02-21T10:05:13.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49892025-02-21T10:05:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49902025-02-21T10:05:13.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.983546ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49912025-02-21T10:05:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49922025-02-21T10:05:13.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49932025-02-21T10:05:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49942025-02-21T10:05:13.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49952025-02-21T10:05:13.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49962025-02-21T10:05:13.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49972025-02-21T10:05:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
49982025-02-21T10:05:13.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49992025-02-21T10:05:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50002025-02-21T10:05:13.581ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
50012025-02-21T10:05:13.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.025022ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
50022025-02-21T10:05:14.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 80e0c1a3-4246-45ff-a750-65b2346d0455 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50032025-02-21T10:05:14.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 80e0c1a3-4246-45ff-a750-65b2346d0455 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50042025-02-21T10:05:14.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 80e0c1a3-4246-45ff-a750-65b2346d0455 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50052025-02-21T10:05:15.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = af5c1f28-c921-4380-a307-8990cdc9b68f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50062025-02-21T10:05:15.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = af5c1f28-c921-4380-a307-8990cdc9b68f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50072025-02-21T10:05:15.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2718 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = af5c1f28-c921-4380-a307-8990cdc9b68f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50082025-02-21T10:05:16.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 10556df1-7046-4140-b7f5-96cf13ea7503 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50092025-02-21T10:05:16.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 10556df1-7046-4140-b7f5-96cf13ea7503 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50102025-02-21T10:05:16.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 10556df1-7046-4140-b7f5-96cf13ea7503 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50112025-02-21T10:05:16.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 579 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = cb2ccfa7-2331-4272-9858-718a376e7c46 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
50122025-02-21T10:05:17.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d406f022-5291-4746-a8b0-463e9f9dfeb7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50132025-02-21T10:05:17.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d406f022-5291-4746-a8b0-463e9f9dfeb7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50142025-02-21T10:05:17.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d406f022-5291-4746-a8b0-463e9f9dfeb7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50152025-02-21T10:05:18.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 53478a1d-9b1d-4454-ad0a-8842ad8152eb roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50162025-02-21T10:05:18.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 53478a1d-9b1d-4454-ad0a-8842ad8152eb resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50172025-02-21T10:05:18.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2091 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 53478a1d-9b1d-4454-ad0a-8842ad8152eb response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50182025-02-21T10:05:19.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8be14d66-b96e-4326-a85e-898ef84c89d7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50192025-02-21T10:05:19.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8be14d66-b96e-4326-a85e-898ef84c89d7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50202025-02-21T10:05:19.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8be14d66-b96e-4326-a85e-898ef84c89d7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50212025-02-21T10:05:20.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bdc9b393-ea85-4f18-aedf-1d33ef4fcc18 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50222025-02-21T10:05:20.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bdc9b393-ea85-4f18-aedf-1d33ef4fcc18 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50232025-02-21T10:05:20.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bdc9b393-ea85-4f18-aedf-1d33ef4fcc18 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50242025-02-21T10:05:21.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84844b3f-ee70-414b-a99b-b3ecc8af65d4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50252025-02-21T10:05:21.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84844b3f-ee70-414b-a99b-b3ecc8af65d4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50262025-02-21T10:05:21.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84844b3f-ee70-414b-a99b-b3ecc8af65d4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50272025-02-21T10:05:22.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = a6f0448e-4817-4c61-85bf-4889cc47e96a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
50282025-02-21T10:05:22.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = a6f0448e-4817-4c61-85bf-4889cc47e96a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
50292025-02-21T10:05:22.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2827 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = a6f0448e-4817-4c61-85bf-4889cc47e96a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
50302025-02-21T10:05:22.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0e6a624d-622e-411c-97b6-11129bc1f0bb roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50312025-02-21T10:05:22.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0e6a624d-622e-411c-97b6-11129bc1f0bb resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50322025-02-21T10:05:22.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2640 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0e6a624d-622e-411c-97b6-11129bc1f0bb response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
50332025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
50342025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50352025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
50362025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
50372025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50382025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
50392025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
50402025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50412025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50422025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
50432025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50442025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
50452025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50462025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
50472025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
50482025-02-21T10:05:23.558ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-21 09:55:23.558866315 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50492025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50502025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
50512025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50522025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
50532025-02-21T10:05:23.558ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50542025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
50552025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
50562025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50572025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50582025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
50592025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50602025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
50612025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50622025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
50632025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50642025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
50652025-02-21T10:05:23.559ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50662025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50672025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
50682025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50692025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
50702025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50712025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50722025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
50732025-02-21T10:05:23.559ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041
50742025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.331\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041"}
50752025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
50762025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
50772025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
50782025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50792025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50802025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
50812025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
50822025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
50832025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50842025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
50852025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
50862025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50872025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50882025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
50892025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50902025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50912025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
50922025-02-21T10:05:23.559ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50932025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50942025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
50952025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50962025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
50972025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
50982025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50992025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51002025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
51012025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51022025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51032025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51042025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51052025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51062025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
51072025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51082025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51092025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51102025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51112025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51122025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51132025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51142025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51152025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51162025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51172025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
51182025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51192025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51202025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51212025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
51222025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51232025-02-21T10:05:23.559ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d154e9e-6d90-4040-b311-004f0e299e85.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e63432d-4205-48df-bd2b-03a054e87ab0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1521, tv_nsec: 857118299 } })
51242025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51252025-02-21T10:05:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51262025-02-21T10:05:23.559ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3bf841e1-42b9-4bd7-ac20-7644b8a83464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1521, tv_nsec: 857154240 } })
51272025-02-21T10:05:23.560ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
51282025-02-21T10:05:23.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.123157ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
51292025-02-21T10:05:23.560ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
51302025-02-21T10:05:23.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.561268ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
51312025-02-21T10:05:23.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51322025-02-21T10:05:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51332025-02-21T10:05:23.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51342025-02-21T10:05:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51352025-02-21T10:05:23.562ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51362025-02-21T10:05:23.562ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.70558ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51372025-02-21T10:05:23.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51382025-02-21T10:05:23.563ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1521, tv_nsec: 860977173 } })
51392025-02-21T10:05:23.563ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
51402025-02-21T10:05:23.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51412025-02-21T10:05:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51422025-02-21T10:05:23.564ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51432025-02-21T10:05:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51442025-02-21T10:05:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51452025-02-21T10:05:23.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51462025-02-21T10:05:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51472025-02-21T10:05:23.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51482025-02-21T10:05:23.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51492025-02-21T10:05:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51502025-02-21T10:05:23.566ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-21 09:55:23.558866315 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
51512025-02-21T10:05:23.566ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.741167ms iteration = 8 status = {"expiration":"2025-02-21T09:55:23.558866315Z","pruned":[]}
51522025-02-21T10:05:23.567ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51532025-02-21T10:05:23.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.598587ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
51542025-02-21T10:05:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51552025-02-21T10:05:23.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51562025-02-21T10:05:23.568ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1521, tv_nsec: 866184578 } })
51572025-02-21T10:05:23.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51582025-02-21T10:05:23.569ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
51592025-02-21T10:05:23.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51602025-02-21T10:05:23.570ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.094217ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
51612025-02-21T10:05:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51622025-02-21T10:05:23.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51632025-02-21T10:05:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51642025-02-21T10:05:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51652025-02-21T10:05:23.571ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51662025-02-21T10:05:23.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51672025-02-21T10:05:23.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51682025-02-21T10:05:23.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51692025-02-21T10:05:23.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51702025-02-21T10:05:23.573ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51712025-02-21T10:05:23.573ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51722025-02-21T10:05:23.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51732025-02-21T10:05:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51742025-02-21T10:05:23.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51752025-02-21T10:05:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51762025-02-21T10:05:23.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51772025-02-21T10:05:23.575ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51782025-02-21T10:05:23.575ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51792025-02-21T10:05:23.575ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51802025-02-21T10:05:23.575ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.121149ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51812025-02-21T10:05:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51822025-02-21T10:05:23.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51832025-02-21T10:05:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51842025-02-21T10:05:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51852025-02-21T10:05:23.580ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51862025-02-21T10:05:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51872025-02-21T10:05:23.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51882025-02-21T10:05:23.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51892025-02-21T10:05:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51902025-02-21T10:05:23.585ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51912025-02-21T10:05:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51922025-02-21T10:05:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51932025-02-21T10:05:23.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51942025-02-21T10:05:23.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51952025-02-21T10:05:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51962025-02-21T10:05:23.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1521, tv_nsec: 887791310 } })
51972025-02-21T10:05:23.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
51982025-02-21T10:05:23.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51992025-02-21T10:05:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52002025-02-21T10:05:23.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52012025-02-21T10:05:23.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52022025-02-21T10:05:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52032025-02-21T10:05:23.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52042025-02-21T10:05:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
52052025-02-21T10:05:23.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52062025-02-21T10:05:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52072025-02-21T10:05:23.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52082025-02-21T10:05:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
52092025-02-21T10:05:23.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52102025-02-21T10:05:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52112025-02-21T10:05:23.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52122025-02-21T10:05:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52132025-02-21T10:05:23.609ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 50.195141ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
52142025-02-21T10:05:23.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.334109ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
52152025-02-21T10:05:23.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.672355ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52162025-02-21T10:05:23.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52172025-02-21T10:05:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52182025-02-21T10:05:23.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52192025-02-21T10:05:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52202025-02-21T10:05:23.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52212025-02-21T10:05:23.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52222025-02-21T10:05:23.622ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52232025-02-21T10:05:23.622ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.443331ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52242025-02-21T10:05:23.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52252025-02-21T10:05:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52262025-02-21T10:05:23.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52272025-02-21T10:05:23.623ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52282025-02-21T10:05:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52292025-02-21T10:05:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52302025-02-21T10:05:23.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52312025-02-21T10:05:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52322025-02-21T10:05:23.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52332025-02-21T10:05:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
52342025-02-21T10:05:23.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52352025-02-21T10:05:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52362025-02-21T10:05:23.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.174349ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52372025-02-21T10:05:23.628ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
52382025-02-21T10:05:23.628ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.149669ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
52392025-02-21T10:05:23.629ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.533783ms iteration = 15 status = 0
52402025-02-21T10:05:23.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52412025-02-21T10:05:23.635ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52422025-02-21T10:05:23.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52432025-02-21T10:05:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52442025-02-21T10:05:23.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52452025-02-21T10:05:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52462025-02-21T10:05:23.640ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
52472025-02-21T10:05:23.640ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
52482025-02-21T10:05:23.640ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.802374ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
52492025-02-21T10:05:23.641ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52502025-02-21T10:05:23.641ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52512025-02-21T10:05:23.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52522025-02-21T10:05:23.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52532025-02-21T10:05:23.644ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
52542025-02-21T10:05:23.644ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52552025-02-21T10:05:23.644ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52562025-02-21T10:05:23.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52572025-02-21T10:05:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52582025-02-21T10:05:23.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52592025-02-21T10:05:23.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52602025-02-21T10:05:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52612025-02-21T10:05:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52622025-02-21T10:05:23.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52632025-02-21T10:05:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52642025-02-21T10:05:23.649ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52652025-02-21T10:05:23.649ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52662025-02-21T10:05:23.649ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52672025-02-21T10:05:23.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52682025-02-21T10:05:23.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52692025-02-21T10:05:23.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52702025-02-21T10:05:23.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52712025-02-21T10:05:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52722025-02-21T10:05:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52732025-02-21T10:05:23.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52742025-02-21T10:05:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52752025-02-21T10:05:23.656ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
52762025-02-21T10:05:23.656ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
52772025-02-21T10:05:23.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52782025-02-21T10:05:23.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52792025-02-21T10:05:23.658ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52802025-02-21T10:05:23.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52812025-02-21T10:05:23.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52822025-02-21T10:05:23.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52832025-02-21T10:05:23.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52842025-02-21T10:05:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52852025-02-21T10:05:23.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52862025-02-21T10:05:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52872025-02-21T10:05:23.665ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
52882025-02-21T10:05:23.665ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
52892025-02-21T10:05:23.665ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-21 09:58:29.164998 UTC dns_group = internal generation = 1
52902025-02-21T10:05:23.665ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 106.238535ms iteration = 8 status = {"generation":1}
52912025-02-21T10:05:23.670ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52922025-02-21T10:05:23.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
52932025-02-21T10:05:23.672ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52942025-02-21T10:05:23.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52952025-02-21T10:05:23.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 114.258178ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52962025-02-21T10:05:23.673ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
52972025-02-21T10:05:23.673ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 114.736759ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
52982025-02-21T10:05:23.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 114.993185ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
52992025-02-21T10:05:23.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53002025-02-21T10:05:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53012025-02-21T10:05:23.686ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53022025-02-21T10:05:23.686ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53032025-02-21T10:05:23.686ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.496228ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53042025-02-21T10:05:23.689ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
53052025-02-21T10:05:23.689ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 0 version = 2
53062025-02-21T10:05:23.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53072025-02-21T10:05:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53082025-02-21T10:05:23.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53092025-02-21T10:05:23.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53102025-02-21T10:05:23.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53112025-02-21T10:05:23.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53122025-02-21T10:05:23.694ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 135.383948ms iteration = 17 status = {"physical_disks_added":0}
53132025-02-21T10:05:23.696ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 1 version = 2
53142025-02-21T10:05:23.696ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
53152025-02-21T10:05:23.696ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-21 09:58:29.727106 UTC dns_group = external generation = 2
53162025-02-21T10:05:23.696ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 137.346025ms iteration = 8 status = {"generation":2}
53172025-02-21T10:05:23.703ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-21T09:58:18.895783Z, time_modified: 2025-02-21T09:58:18.895783Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }) }
53182025-02-21T10:05:23.703ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 144.463177ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]}},"default_endpoint":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
53192025-02-21T10:05:23.704ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
53202025-02-21T10:05:23.714ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
53212025-02-21T10:05:23.714ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53222025-02-21T10:05:23.714ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbe73a66-9421-46d3-ac00-fc183cf0d185", "content-length": "26", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
53232025-02-21T10:05:23.714ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53242025-02-21T10:05:23.716ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53252025-02-21T10:05:23.716ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
53262025-02-21T10:05:23.716ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53272025-02-21T10:05:23.717ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc0847c5-f93f-4985-98ee-3a053ed713a6", "content-length": "26", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
53282025-02-21T10:05:23.717ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53292025-02-21T10:05:23.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0960682c-31cb-47af-8391-d5b28dbdcb3a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
53302025-02-21T10:05:23.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0960682c-31cb-47af-8391-d5b28dbdcb3a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
53312025-02-21T10:05:23.718ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53322025-02-21T10:05:23.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0960682c-31cb-47af-8391-d5b28dbdcb3a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
53332025-02-21T10:05:23.741ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53342025-02-21T10:05:23.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53352025-02-21T10:05:23.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53362025-02-21T10:05:23.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53372025-02-21T10:05:23.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53382025-02-21T10:05:23.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53392025-02-21T10:05:23.746ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53402025-02-21T10:05:23.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53412025-02-21T10:05:23.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53422025-02-21T10:05:23.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53432025-02-21T10:05:23.761ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
53442025-02-21T10:05:23.761ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 202.211921ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
53452025-02-21T10:05:23.791ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
53462025-02-21T10:05:23.838ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53472025-02-21T10:05:23.838ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53482025-02-21T10:05:23.838ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "23088527-71e6-4efc-b1e8-9157d2d948b9", "content-length": "372", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
53492025-02-21T10:05:23.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53502025-02-21T10:05:23.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53512025-02-21T10:05:23.863ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
53522025-02-21T10:05:23.863ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "aef401fc-a3e5-4403-95f1-a4ce93b7bc96", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53532025-02-21T10:05:23.863ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53542025-02-21T10:05:23.865ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1fa1e4d9-6be9-4abd-93e2-68d9dcb64ed4", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53552025-02-21T10:05:23.865ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53562025-02-21T10:05:23.866ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53572025-02-21T10:05:23.866ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 307.430071ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
53582025-02-21T10:05:23.881ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
53592025-02-21T10:05:23.881ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53602025-02-21T10:05:23.882ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0de7aadb-cdce-4ae7-8ad9-5539083dcc1e", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
53612025-02-21T10:05:23.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53622025-02-21T10:05:23.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53632025-02-21T10:05:23.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53642025-02-21T10:05:23.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53652025-02-21T10:05:23.886ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53662025-02-21T10:05:23.886ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "415d7eb5-c452-4ddf-af22-84b36d835f96", "content-length": "1", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
53672025-02-21T10:05:23.887ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53682025-02-21T10:05:23.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53692025-02-21T10:05:23.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53702025-02-21T10:05:23.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53712025-02-21T10:05:23.897ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
53722025-02-21T10:05:23.897ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53732025-02-21T10:05:23.897ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d160ef01-6ecb-431d-b9f1-80b3e2e65f61", "content-length": "26", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
53742025-02-21T10:05:23.897ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53752025-02-21T10:05:23.898ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 340.010408ms iteration = 15 status = {}
53762025-02-21T10:05:23.899ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
53772025-02-21T10:05:23.933ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53782025-02-21T10:05:23.933ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd1a20b3-9c08-4e97-938f-fa430ef91e15", "content-length": "691", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
53792025-02-21T10:05:23.933ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
53802025-02-21T10:05:23.933ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
53812025-02-21T10:05:23.933ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
53822025-02-21T10:05:23.934ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 375.396822ms iteration = 15 status = {}
53832025-02-21T10:05:23.935ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 376.668624ms iteration = 15 status = null
53842025-02-21T10:05:23.936ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53852025-02-21T10:05:23.936ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53862025-02-21T10:05:23.937ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "32acc96d-932c-4357-8a27-ff24d68a7e27", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
53872025-02-21T10:05:23.938ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 379.587544ms iteration = 15 status = {}
53882025-02-21T10:05:23.942ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53892025-02-21T10:05:24.002ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53902025-02-21T10:05:24.003ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "99da669c-8a81-4d96-be72-4b2df3b4c650", "date": "Fri, 21 Feb 2025 10:05:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53912025-02-21T10:05:24.003ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53922025-02-21T10:05:24.003ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "37cbddf9-7f33-4b03-9e0a-01db64a5a5a3", "date": "Fri, 21 Feb 2025 10:05:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53932025-02-21T10:05:24.003ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53942025-02-21T10:05:24.004ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2af650d2-ab5b-40ff-8f02-4043b2e9c1be", "date": "Fri, 21 Feb 2025 10:05:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53952025-02-21T10:05:24.004ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53962025-02-21T10:05:24.006ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53972025-02-21T10:05:24.006ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 447.566945ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53982025-02-21T10:05:24.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53992025-02-21T10:05:24.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54002025-02-21T10:05:24.061ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
54012025-02-21T10:05:24.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54022025-02-21T10:05:24.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54032025-02-21T10:05:24.070ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54042025-02-21T10:05:24.070ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d5aecd3-9986-4209-bddd-8dcb2be0605b", "content-length": "134", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
54052025-02-21T10:05:24.070ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
54062025-02-21T10:05:24.070ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
54072025-02-21T10:05:24.070ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54082025-02-21T10:05:24.070ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54092025-02-21T10:05:24.070ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54102025-02-21T10:05:24.070ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54112025-02-21T10:05:24.070ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54122025-02-21T10:05:24.070ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54132025-02-21T10:05:24.070ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54142025-02-21T10:05:24.070ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54152025-02-21T10:05:24.071ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
54162025-02-21T10:05:24.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54172025-02-21T10:05:24.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54182025-02-21T10:05:24.073ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54192025-02-21T10:05:24.073ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "14ebcb7f-8fac-48c4-aa44-925eb8b9facd", "content-length": "2", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
54202025-02-21T10:05:24.073ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54212025-02-21T10:05:24.073ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dac4ad3a-161a-435e-9d12-0a76b947a504", "content-length": "52", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
54222025-02-21T10:05:24.073ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
54232025-02-21T10:05:24.073ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54242025-02-21T10:05:24.167ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e97f3be1-b624-4ac8-8c52-066a86cd8022", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
54252025-02-21T10:05:24.167ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
54262025-02-21T10:05:24.167ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54272025-02-21T10:05:24.168ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6fdd780-3a0a-41e1-bc0c-8610d7d03f7b", "content-length": "682", "date": "Fri, 21 Feb 2025 10:05:23 GMT"} })
54282025-02-21T10:05:24.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54292025-02-21T10:05:24.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54302025-02-21T10:05:24.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54312025-02-21T10:05:24.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54322025-02-21T10:05:24.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54332025-02-21T10:05:24.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54342025-02-21T10:05:24.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54352025-02-21T10:05:24.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54362025-02-21T10:05:24.183ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 624.972557ms iteration = 15 status = {}
54372025-02-21T10:05:24.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d3c99d75-fa1d-442c-81bf-1d452148d90c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54382025-02-21T10:05:24.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d3c99d75-fa1d-442c-81bf-1d452148d90c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54392025-02-21T10:05:24.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1677 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d3c99d75-fa1d-442c-81bf-1d452148d90c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54402025-02-21T10:05:25.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ffe1be18-f427-439b-b927-9b1d095a7ab3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54412025-02-21T10:05:25.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ffe1be18-f427-439b-b927-9b1d095a7ab3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54422025-02-21T10:05:25.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ffe1be18-f427-439b-b927-9b1d095a7ab3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54432025-02-21T10:05:26.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 561 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = a91ccc76-ef5e-4626-b50b-cd8d1eb35035 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
54442025-02-21T10:05:26.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6d23e8a3-9b29-4a00-bce5-9d9d750d28e9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54452025-02-21T10:05:26.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6d23e8a3-9b29-4a00-bce5-9d9d750d28e9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54462025-02-21T10:05:26.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2492 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6d23e8a3-9b29-4a00-bce5-9d9d750d28e9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54472025-02-21T10:05:27.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 36bc8fcc-368a-42ac-838f-401c17dec6fd roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54482025-02-21T10:05:27.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 36bc8fcc-368a-42ac-838f-401c17dec6fd resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54492025-02-21T10:05:27.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 36bc8fcc-368a-42ac-838f-401c17dec6fd response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54502025-02-21T10:05:28.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 17028f20-9b3c-455b-9582-4f7895b06b04 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54512025-02-21T10:05:28.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 17028f20-9b3c-455b-9582-4f7895b06b04 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54522025-02-21T10:05:28.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 17028f20-9b3c-455b-9582-4f7895b06b04 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54532025-02-21T10:05:29.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 584e4271-1855-4ca8-bd0d-e681f7e0c0c6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54542025-02-21T10:05:29.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 584e4271-1855-4ca8-bd0d-e681f7e0c0c6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54552025-02-21T10:05:29.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1913 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 584e4271-1855-4ca8-bd0d-e681f7e0c0c6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54562025-02-21T10:05:30.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4bab7e0f-ae8f-44e2-9a23-811e3c26b619 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54572025-02-21T10:05:30.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4bab7e0f-ae8f-44e2-9a23-811e3c26b619 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54582025-02-21T10:05:30.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4bab7e0f-ae8f-44e2-9a23-811e3c26b619 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54592025-02-21T10:05:31.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bbaf53d1-61b1-47f2-bbc4-71d9fb69e7d4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54602025-02-21T10:05:31.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bbaf53d1-61b1-47f2-bbc4-71d9fb69e7d4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54612025-02-21T10:05:31.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bbaf53d1-61b1-47f2-bbc4-71d9fb69e7d4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54622025-02-21T10:05:32.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ca7713e4-2388-4aa6-8669-e5a7937bd47a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54632025-02-21T10:05:32.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ca7713e4-2388-4aa6-8669-e5a7937bd47a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54642025-02-21T10:05:32.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ca7713e4-2388-4aa6-8669-e5a7937bd47a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54652025-02-21T10:05:33.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
54662025-02-21T10:05:33.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
54672025-02-21T10:05:33.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54682025-02-21T10:05:33.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54692025-02-21T10:05:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54702025-02-21T10:05:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54712025-02-21T10:05:33.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54722025-02-21T10:05:33.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54732025-02-21T10:05:33.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54742025-02-21T10:05:33.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54752025-02-21T10:05:33.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54762025-02-21T10:05:33.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54772025-02-21T10:05:33.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54782025-02-21T10:05:33.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54792025-02-21T10:05:33.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802025-02-21T10:05:33.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
54812025-02-21T10:05:33.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54822025-02-21T10:05:33.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54832025-02-21T10:05:33.584ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
54842025-02-21T10:05:33.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.431423ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
54852025-02-21T10:05:33.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.297583ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54862025-02-21T10:05:33.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cc4a99a1-bf25-4371-9436-b192f340e7db roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54872025-02-21T10:05:33.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cc4a99a1-bf25-4371-9436-b192f340e7db resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54882025-02-21T10:05:33.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cc4a99a1-bf25-4371-9436-b192f340e7db response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54892025-02-21T10:05:34.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5978e7ed-4bc3-43e0-b53d-1e99fcb7354c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54902025-02-21T10:05:34.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5978e7ed-4bc3-43e0-b53d-1e99fcb7354c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54912025-02-21T10:05:34.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5978e7ed-4bc3-43e0-b53d-1e99fcb7354c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54922025-02-21T10:05:35.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a361f66a-b64c-410b-be2e-d81867244355 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54932025-02-21T10:05:35.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a361f66a-b64c-410b-be2e-d81867244355 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54942025-02-21T10:05:35.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a361f66a-b64c-410b-be2e-d81867244355 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54952025-02-21T10:05:36.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 554 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = a180bc90-f29c-402d-9550-983ac72238c7 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
54962025-02-21T10:05:37.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 44e83d49-f771-4bd1-a051-58707c264f9b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54972025-02-21T10:05:37.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 44e83d49-f771-4bd1-a051-58707c264f9b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54982025-02-21T10:05:37.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 44e83d49-f771-4bd1-a051-58707c264f9b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
54992025-02-21T10:05:38.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a83461c9-2e4c-41e7-aca3-e2800a69b24c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55002025-02-21T10:05:38.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a83461c9-2e4c-41e7-aca3-e2800a69b24c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55012025-02-21T10:05:38.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a83461c9-2e4c-41e7-aca3-e2800a69b24c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55022025-02-21T10:05:39.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f9c34fb3-daff-4008-b81f-e62fe3a9c0d4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55032025-02-21T10:05:39.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f9c34fb3-daff-4008-b81f-e62fe3a9c0d4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55042025-02-21T10:05:39.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f9c34fb3-daff-4008-b81f-e62fe3a9c0d4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55052025-02-21T10:05:40.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 83337d15-4fb9-4497-b3db-388fc3b6d96c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55062025-02-21T10:05:40.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 83337d15-4fb9-4497-b3db-388fc3b6d96c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55072025-02-21T10:05:40.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 83337d15-4fb9-4497-b3db-388fc3b6d96c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55082025-02-21T10:05:41.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cf170262-9712-4ac6-a400-3717fb0441ab roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55092025-02-21T10:05:41.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cf170262-9712-4ac6-a400-3717fb0441ab resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55102025-02-21T10:05:41.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cf170262-9712-4ac6-a400-3717fb0441ab response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55112025-02-21T10:05:42.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 510c9096-818b-4d1a-b19a-8399a09e860c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55122025-02-21T10:05:42.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 510c9096-818b-4d1a-b19a-8399a09e860c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55132025-02-21T10:05:42.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 510c9096-818b-4d1a-b19a-8399a09e860c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55142025-02-21T10:05:43.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cbf53b03-b301-4051-818f-70886c18638c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55152025-02-21T10:05:43.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cbf53b03-b301-4051-818f-70886c18638c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55162025-02-21T10:05:43.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cbf53b03-b301-4051-818f-70886c18638c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55172025-02-21T10:05:43.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
55182025-02-21T10:05:43.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
55192025-02-21T10:05:43.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55202025-02-21T10:05:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55212025-02-21T10:05:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55222025-02-21T10:05:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55232025-02-21T10:05:43.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55242025-02-21T10:05:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55252025-02-21T10:05:43.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55262025-02-21T10:05:43.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.445287ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55272025-02-21T10:05:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55282025-02-21T10:05:43.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55292025-02-21T10:05:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55302025-02-21T10:05:43.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55312025-02-21T10:05:43.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55322025-02-21T10:05:43.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55332025-02-21T10:05:43.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
55342025-02-21T10:05:43.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55352025-02-21T10:05:43.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55362025-02-21T10:05:43.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
55372025-02-21T10:05:43.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.811298ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
55382025-02-21T10:05:44.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8332970a-ed80-43be-8458-cd272a6e889a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55392025-02-21T10:05:44.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8332970a-ed80-43be-8458-cd272a6e889a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55402025-02-21T10:05:44.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8332970a-ed80-43be-8458-cd272a6e889a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55412025-02-21T10:05:45.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8333ee77-3b4d-4727-8183-59428337120f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55422025-02-21T10:05:45.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8333ee77-3b4d-4727-8183-59428337120f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55432025-02-21T10:05:45.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8333ee77-3b4d-4727-8183-59428337120f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55442025-02-21T10:05:46.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6b10e49c-a510-4ed9-a0d8-4fedd10a4ee8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55452025-02-21T10:05:46.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6b10e49c-a510-4ed9-a0d8-4fedd10a4ee8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55462025-02-21T10:05:46.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6b10e49c-a510-4ed9-a0d8-4fedd10a4ee8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55472025-02-21T10:05:46.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 492 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = d90e2a34-fc4e-4d46-aa61-08b901cb9d4c response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
55482025-02-21T10:05:47.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49f948e7-9b63-4744-a704-dbdbe9546b49 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55492025-02-21T10:05:47.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49f948e7-9b63-4744-a704-dbdbe9546b49 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55502025-02-21T10:05:47.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49f948e7-9b63-4744-a704-dbdbe9546b49 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55512025-02-21T10:05:48.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dd826795-eb4b-4f78-a4b4-452510011ebd roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55522025-02-21T10:05:48.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dd826795-eb4b-4f78-a4b4-452510011ebd resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55532025-02-21T10:05:48.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1780 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dd826795-eb4b-4f78-a4b4-452510011ebd response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55542025-02-21T10:05:49.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 394520fc-10fb-44c2-8406-60fe96f531a7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55552025-02-21T10:05:49.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 394520fc-10fb-44c2-8406-60fe96f531a7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55562025-02-21T10:05:49.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1742 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 394520fc-10fb-44c2-8406-60fe96f531a7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55572025-02-21T10:05:50.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6d6088fe-ee56-46a0-acf1-e0577211a542 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55582025-02-21T10:05:50.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6d6088fe-ee56-46a0-acf1-e0577211a542 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55592025-02-21T10:05:50.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2489 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6d6088fe-ee56-46a0-acf1-e0577211a542 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55602025-02-21T10:05:51.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b4e50d13-61d5-4237-9f7a-c1186a125a38 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55612025-02-21T10:05:51.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b4e50d13-61d5-4237-9f7a-c1186a125a38 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55622025-02-21T10:05:51.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b4e50d13-61d5-4237-9f7a-c1186a125a38 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55632025-02-21T10:05:52.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = e5638077-aefe-40e6-b572-30e8c06652f2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55642025-02-21T10:05:52.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = e5638077-aefe-40e6-b572-30e8c06652f2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55652025-02-21T10:05:52.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3588 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = e5638077-aefe-40e6-b572-30e8c06652f2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55662025-02-21T10:05:52.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 16e21059-4525-4c1d-b340-2208ce2aa090 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55672025-02-21T10:05:52.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 16e21059-4525-4c1d-b340-2208ce2aa090 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55682025-02-21T10:05:52.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 16e21059-4525-4c1d-b340-2208ce2aa090 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55692025-02-21T10:05:53.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a73fa00c-b4a3-426b-bc8e-6916bada6278 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55702025-02-21T10:05:53.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a73fa00c-b4a3-426b-bc8e-6916bada6278 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55712025-02-21T10:05:53.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a73fa00c-b4a3-426b-bc8e-6916bada6278 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
55722025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
55732025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
55742025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55752025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55762025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
55772025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
55782025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55792025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
55802025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
55812025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
55822025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55832025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55842025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55852025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
55862025-02-21T10:05:53.558ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
55872025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55882025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
55892025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
55902025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55912025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55922025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
55932025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55942025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
55952025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55962025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
55972025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55982025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
55992025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56002025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
56012025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
56022025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56032025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
56042025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
56052025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56062025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
56072025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56082025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56092025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
56102025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56112025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56122025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
56132025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56142025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56152025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56162025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56172025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56182025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56192025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56202025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56212025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56222025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56232025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56242025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56252025-02-21T10:05:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56262025-02-21T10:05:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56272025-02-21T10:05:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56282025-02-21T10:05:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56292025-02-21T10:05:53.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56302025-02-21T10:05:53.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56312025-02-21T10:05:53.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56322025-02-21T10:05:53.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56332025-02-21T10:05:53.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56342025-02-21T10:05:53.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56352025-02-21T10:05:53.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56362025-02-21T10:05:53.565ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.176593ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56372025-02-21T10:05:53.565ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 7.45932ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
56382025-02-21T10:05:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56392025-02-21T10:05:53.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56402025-02-21T10:05:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56412025-02-21T10:05:53.568ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1551, tv_nsec: 865609235 } })
56422025-02-21T10:05:53.568ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1551, tv_nsec: 865880311 } })
56432025-02-21T10:05:53.568ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
56442025-02-21T10:05:53.568ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
56452025-02-21T10:05:53.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56462025-02-21T10:05:53.569ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56472025-02-21T10:05:53.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56482025-02-21T10:05:53.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56492025-02-21T10:05:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56502025-02-21T10:05:53.571ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56512025-02-21T10:05:53.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56522025-02-21T10:05:53.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56532025-02-21T10:05:53.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56542025-02-21T10:05:53.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56552025-02-21T10:05:53.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56562025-02-21T10:05:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56572025-02-21T10:05:53.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56582025-02-21T10:05:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56592025-02-21T10:05:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56602025-02-21T10:05:53.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56612025-02-21T10:05:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56622025-02-21T10:05:53.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56632025-02-21T10:05:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56642025-02-21T10:05:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56652025-02-21T10:05:53.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56662025-02-21T10:05:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56672025-02-21T10:05:53.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56682025-02-21T10:05:53.582ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1551, tv_nsec: 880395931 } })
56692025-02-21T10:05:53.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
56702025-02-21T10:05:53.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56712025-02-21T10:05:53.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56722025-02-21T10:05:53.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56732025-02-21T10:05:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56742025-02-21T10:05:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56752025-02-21T10:05:53.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56762025-02-21T10:05:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56772025-02-21T10:05:53.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56782025-02-21T10:05:53.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
56792025-02-21T10:05:53.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56802025-02-21T10:05:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56812025-02-21T10:05:53.604ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56822025-02-21T10:05:53.604ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56832025-02-21T10:05:53.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56842025-02-21T10:05:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56852025-02-21T10:05:53.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56862025-02-21T10:05:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56872025-02-21T10:05:53.606ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56882025-02-21T10:05:53.606ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56892025-02-21T10:05:53.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56902025-02-21T10:05:53.606ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
56912025-02-21T10:05:53.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.245884ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
56922025-02-21T10:05:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56932025-02-21T10:05:53.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.415902ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
56942025-02-21T10:05:53.615ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56952025-02-21T10:05:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56962025-02-21T10:05:53.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56972025-02-21T10:05:53.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56982025-02-21T10:05:53.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.558449ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
56992025-02-21T10:05:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57002025-02-21T10:05:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57012025-02-21T10:05:53.617ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57022025-02-21T10:05:53.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.324912ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57032025-02-21T10:05:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
57042025-02-21T10:05:53.619ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57052025-02-21T10:05:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57062025-02-21T10:05:53.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
57072025-02-21T10:05:53.619ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57082025-02-21T10:05:53.620ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b173d028-f2c6-4a69-81fb-4fcbe6df1aed", "content-length": "26", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
57092025-02-21T10:05:53.620ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57102025-02-21T10:05:53.623ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57112025-02-21T10:05:53.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.880549ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57122025-02-21T10:05:53.631ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
57132025-02-21T10:05:53.631ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57142025-02-21T10:05:53.632ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8839e1c7-49fe-4ff1-9df1-6f004c215a74", "content-length": "26", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
57152025-02-21T10:05:53.632ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57162025-02-21T10:05:53.632ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57172025-02-21T10:05:53.632ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.829441ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57182025-02-21T10:05:53.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57192025-02-21T10:05:53.634ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57202025-02-21T10:05:53.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57212025-02-21T10:05:53.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57222025-02-21T10:05:53.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57232025-02-21T10:05:53.639ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
57242025-02-21T10:05:53.639ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57252025-02-21T10:05:53.639ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2be4ed8b-c014-4573-8b10-786db34aa95d", "content-length": "26", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
57262025-02-21T10:05:53.639ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57272025-02-21T10:05:53.640ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
57282025-02-21T10:05:53.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57292025-02-21T10:05:53.643ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57302025-02-21T10:05:53.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57312025-02-21T10:05:53.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57322025-02-21T10:05:53.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57332025-02-21T10:05:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57342025-02-21T10:05:53.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.533356ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57352025-02-21T10:05:53.662ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57362025-02-21T10:05:53.662ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57372025-02-21T10:05:53.662ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.207365ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57382025-02-21T10:05:53.671ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
57392025-02-21T10:05:53.671ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 113.329945ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
57402025-02-21T10:05:53.685ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.877252ms iteration = 18 status = {"physical_disks_added":0}
57412025-02-21T10:05:53.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 129.000174ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
57422025-02-21T10:05:53.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57432025-02-21T10:05:53.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
57442025-02-21T10:05:53.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57452025-02-21T10:05:53.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57462025-02-21T10:05:53.697ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 139.360603ms iteration = 16 status = 0
57472025-02-21T10:05:53.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57482025-02-21T10:05:53.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57492025-02-21T10:05:53.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57502025-02-21T10:05:53.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57512025-02-21T10:05:53.723ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 165.215298ms iteration = 16 status = {}
57522025-02-21T10:05:53.736ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57532025-02-21T10:05:53.736ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b10c397d-c0aa-4326-a4ee-5b53810f462a", "content-length": "1", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
57542025-02-21T10:05:53.738ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57552025-02-21T10:05:53.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57562025-02-21T10:05:53.742ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57572025-02-21T10:05:53.742ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57582025-02-21T10:05:53.743ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8479f1b8-49c5-47a0-98ec-649f38998767", "content-length": "372", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
57592025-02-21T10:05:53.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57602025-02-21T10:05:53.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57612025-02-21T10:05:53.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57622025-02-21T10:05:53.745ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 186.796549ms iteration = 16 status = null
57632025-02-21T10:05:53.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57642025-02-21T10:05:53.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57652025-02-21T10:05:53.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57662025-02-21T10:05:53.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57672025-02-21T10:05:53.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57682025-02-21T10:05:53.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57692025-02-21T10:05:53.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57702025-02-21T10:05:53.784ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
57712025-02-21T10:05:53.784ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57722025-02-21T10:05:53.785ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "72bbd01d-90c1-4a1b-aa92-92da00095665", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
57732025-02-21T10:05:53.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57742025-02-21T10:05:53.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57752025-02-21T10:05:53.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57762025-02-21T10:05:53.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57772025-02-21T10:05:53.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57782025-02-21T10:05:53.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57792025-02-21T10:05:53.794ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57802025-02-21T10:05:53.794ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57812025-02-21T10:05:53.794ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0d0b55eb-71f9-4c7d-b381-7511ceae9776", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
57822025-02-21T10:05:53.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57832025-02-21T10:05:53.796ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 237.928603ms iteration = 16 status = {}
57842025-02-21T10:05:53.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57852025-02-21T10:05:53.797ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
57862025-02-21T10:05:53.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57872025-02-21T10:05:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57882025-02-21T10:05:53.807ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57892025-02-21T10:05:53.807ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4698e88-b9da-428b-a1b9-0035f1c98c32", "content-length": "134", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
57902025-02-21T10:05:53.807ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57912025-02-21T10:05:53.807ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
57922025-02-21T10:05:53.807ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57932025-02-21T10:05:53.807ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57942025-02-21T10:05:53.807ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57952025-02-21T10:05:53.807ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57962025-02-21T10:05:53.807ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57972025-02-21T10:05:53.807ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57982025-02-21T10:05:53.808ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57992025-02-21T10:05:53.808ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58002025-02-21T10:05:53.808ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
58012025-02-21T10:05:53.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58022025-02-21T10:05:53.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58032025-02-21T10:05:53.834ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58042025-02-21T10:05:53.835ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7929961-449e-48c3-b6b2-585ab462d445", "content-length": "691", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
58052025-02-21T10:05:53.835ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58062025-02-21T10:05:53.835ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58072025-02-21T10:05:53.835ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58082025-02-21T10:05:53.835ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 277.319865ms iteration = 16 status = {}
58092025-02-21T10:05:53.836ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
58102025-02-21T10:05:53.836ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e8c5fc3-e13f-4600-b7d8-c4058ecceb8c", "content-length": "2", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
58112025-02-21T10:05:53.836ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
58122025-02-21T10:05:53.837ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a47b3b37-4775-4a8a-8cc6-8ee390692be1", "content-length": "52", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
58132025-02-21T10:05:53.837ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
58142025-02-21T10:05:53.837ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58152025-02-21T10:05:53.931ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5349bcc0-2029-4aec-85e2-bbd89f5178ec", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
58162025-02-21T10:05:53.931ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
58172025-02-21T10:05:53.931ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58182025-02-21T10:05:53.931ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "156f0b12-2310-4476-8953-7a3d7285790c", "content-length": "682", "date": "Fri, 21 Feb 2025 10:05:53 GMT"} })
58192025-02-21T10:05:53.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58202025-02-21T10:05:53.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58212025-02-21T10:05:53.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58222025-02-21T10:05:53.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58232025-02-21T10:05:53.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58242025-02-21T10:05:53.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58252025-02-21T10:05:53.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58262025-02-21T10:05:53.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58272025-02-21T10:05:53.947ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 388.866917ms iteration = 16 status = {}
58282025-02-21T10:05:54.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb93b468-0c8b-4b91-86c0-11ac9ded64ee roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58292025-02-21T10:05:54.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb93b468-0c8b-4b91-86c0-11ac9ded64ee resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58302025-02-21T10:05:54.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb93b468-0c8b-4b91-86c0-11ac9ded64ee response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58312025-02-21T10:05:55.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 033af703-519a-4c38-9ea0-ddeaab406889 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58322025-02-21T10:05:55.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 033af703-519a-4c38-9ea0-ddeaab406889 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58332025-02-21T10:05:55.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 033af703-519a-4c38-9ea0-ddeaab406889 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58342025-02-21T10:05:56.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c9a67ccd-858f-4247-8aaa-638cb08dcb29 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58352025-02-21T10:05:56.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c9a67ccd-858f-4247-8aaa-638cb08dcb29 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58362025-02-21T10:05:56.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2683 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c9a67ccd-858f-4247-8aaa-638cb08dcb29 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58372025-02-21T10:05:56.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 452 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 3c5f7c79-e7d5-4488-b672-a78b8d2d97d7 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
58382025-02-21T10:05:57.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e0e99aba-d886-46e6-a4d9-de7b4a4e7f5e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58392025-02-21T10:05:57.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e0e99aba-d886-46e6-a4d9-de7b4a4e7f5e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58402025-02-21T10:05:57.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e0e99aba-d886-46e6-a4d9-de7b4a4e7f5e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58412025-02-21T10:05:58.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e5fdbc37-d0f2-4ee2-9252-74204d1eb449 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58422025-02-21T10:05:58.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e5fdbc37-d0f2-4ee2-9252-74204d1eb449 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58432025-02-21T10:05:58.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2674 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e5fdbc37-d0f2-4ee2-9252-74204d1eb449 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58442025-02-21T10:05:59.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55b53058-8c72-4884-9fb2-6e9b89f6e97f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58452025-02-21T10:05:59.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55b53058-8c72-4884-9fb2-6e9b89f6e97f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58462025-02-21T10:05:59.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55b53058-8c72-4884-9fb2-6e9b89f6e97f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58472025-02-21T10:06:00.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c2f84337-429e-41e8-bbc9-b4a0b0376696 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58482025-02-21T10:06:00.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c2f84337-429e-41e8-bbc9-b4a0b0376696 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58492025-02-21T10:06:00.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c2f84337-429e-41e8-bbc9-b4a0b0376696 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58502025-02-21T10:06:01.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e5554698-d76f-4b24-8496-6781a44a79d2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58512025-02-21T10:06:01.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e5554698-d76f-4b24-8496-6781a44a79d2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58522025-02-21T10:06:01.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e5554698-d76f-4b24-8496-6781a44a79d2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58532025-02-21T10:06:02.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5ec890ad-7341-4765-a980-125309443746 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58542025-02-21T10:06:02.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5ec890ad-7341-4765-a980-125309443746 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58552025-02-21T10:06:02.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2576 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5ec890ad-7341-4765-a980-125309443746 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58562025-02-21T10:06:03.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
58572025-02-21T10:06:03.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
58582025-02-21T10:06:03.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58592025-02-21T10:06:03.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58602025-02-21T10:06:03.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58612025-02-21T10:06:03.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58622025-02-21T10:06:03.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58632025-02-21T10:06:03.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58642025-02-21T10:06:03.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58652025-02-21T10:06:03.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58662025-02-21T10:06:03.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58672025-02-21T10:06:03.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58682025-02-21T10:06:03.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58692025-02-21T10:06:03.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
58702025-02-21T10:06:03.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58712025-02-21T10:06:03.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58722025-02-21T10:06:03.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 138eca27-d84b-43ca-b86a-c8acc7be9a64 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58732025-02-21T10:06:03.581ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
58742025-02-21T10:06:03.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.257381ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
58752025-02-21T10:06:03.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 138eca27-d84b-43ca-b86a-c8acc7be9a64 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58762025-02-21T10:06:03.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 138eca27-d84b-43ca-b86a-c8acc7be9a64 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58772025-02-21T10:06:03.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58782025-02-21T10:06:03.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58792025-02-21T10:06:03.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.333411ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58802025-02-21T10:06:04.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 45b9b0bf-8b6f-4688-a4b1-424ef0d4c663 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58812025-02-21T10:06:04.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 45b9b0bf-8b6f-4688-a4b1-424ef0d4c663 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58822025-02-21T10:06:04.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 45b9b0bf-8b6f-4688-a4b1-424ef0d4c663 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58832025-02-21T10:06:05.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8c7b298a-b05f-4547-828f-02467f80409c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58842025-02-21T10:06:05.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8c7b298a-b05f-4547-828f-02467f80409c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58852025-02-21T10:06:05.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2574 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8c7b298a-b05f-4547-828f-02467f80409c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58862025-02-21T10:06:06.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 470 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = da9a603d-3b70-4bfa-85ef-ea996e91cb38 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
58872025-02-21T10:06:06.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f9aaf815-a605-409f-9a00-7eeda8556e33 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58882025-02-21T10:06:06.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f9aaf815-a605-409f-9a00-7eeda8556e33 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58892025-02-21T10:06:06.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f9aaf815-a605-409f-9a00-7eeda8556e33 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58902025-02-21T10:06:07.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9986addf-aec8-4eb9-8210-2256636fd505 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58912025-02-21T10:06:07.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9986addf-aec8-4eb9-8210-2256636fd505 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58922025-02-21T10:06:07.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1668 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9986addf-aec8-4eb9-8210-2256636fd505 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58932025-02-21T10:06:08.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bce06c0b-0fda-4a92-a5d8-4e3458227418 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58942025-02-21T10:06:08.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bce06c0b-0fda-4a92-a5d8-4e3458227418 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58952025-02-21T10:06:08.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bce06c0b-0fda-4a92-a5d8-4e3458227418 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58962025-02-21T10:06:09.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 146061d2-9a6f-410a-9030-db3dfc7dcec4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58972025-02-21T10:06:09.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 146061d2-9a6f-410a-9030-db3dfc7dcec4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58982025-02-21T10:06:09.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 146061d2-9a6f-410a-9030-db3dfc7dcec4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
58992025-02-21T10:06:10.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 325d03a4-dce3-4a94-966d-bd33028a5c36 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59002025-02-21T10:06:10.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 325d03a4-dce3-4a94-966d-bd33028a5c36 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59012025-02-21T10:06:10.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1699 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 325d03a4-dce3-4a94-966d-bd33028a5c36 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59022025-02-21T10:06:11.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a65cd3eb-42a4-42e7-99a1-b0206f960bb1 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59032025-02-21T10:06:11.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a65cd3eb-42a4-42e7-99a1-b0206f960bb1 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59042025-02-21T10:06:11.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1743 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a65cd3eb-42a4-42e7-99a1-b0206f960bb1 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59052025-02-21T10:06:12.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5da1c805-374f-4dbd-9852-8d55fca12428 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59062025-02-21T10:06:12.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5da1c805-374f-4dbd-9852-8d55fca12428 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59072025-02-21T10:06:12.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5da1c805-374f-4dbd-9852-8d55fca12428 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59082025-02-21T10:06:13.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
59092025-02-21T10:06:13.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59102025-02-21T10:06:13.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
59112025-02-21T10:06:13.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59122025-02-21T10:06:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59132025-02-21T10:06:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59142025-02-21T10:06:13.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59152025-02-21T10:06:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59162025-02-21T10:06:13.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59172025-02-21T10:06:13.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.459914ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59182025-02-21T10:06:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59192025-02-21T10:06:13.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59202025-02-21T10:06:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59212025-02-21T10:06:13.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59222025-02-21T10:06:13.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59232025-02-21T10:06:13.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59242025-02-21T10:06:13.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
59252025-02-21T10:06:13.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59262025-02-21T10:06:13.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59272025-02-21T10:06:13.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
59282025-02-21T10:06:13.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.267477ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
59292025-02-21T10:06:13.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0ba80234-26ee-407d-870d-e914d5481590 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59302025-02-21T10:06:13.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0ba80234-26ee-407d-870d-e914d5481590 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59312025-02-21T10:06:13.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1986 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0ba80234-26ee-407d-870d-e914d5481590 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59322025-02-21T10:06:14.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29bc7b06-3e5e-4926-95f2-b5823f937384 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59332025-02-21T10:06:14.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29bc7b06-3e5e-4926-95f2-b5823f937384 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59342025-02-21T10:06:14.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29bc7b06-3e5e-4926-95f2-b5823f937384 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59352025-02-21T10:06:15.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ebd25cbb-df98-444c-87ab-ae44a0f7ad3c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59362025-02-21T10:06:15.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ebd25cbb-df98-444c-87ab-ae44a0f7ad3c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59372025-02-21T10:06:15.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ebd25cbb-df98-444c-87ab-ae44a0f7ad3c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59382025-02-21T10:06:16.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 769 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = addef00d-5652-4bf7-babd-be9dd51a8b03 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
59392025-02-21T10:06:16.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c530f77-e730-4712-8617-41eda8c9d00b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59402025-02-21T10:06:16.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c530f77-e730-4712-8617-41eda8c9d00b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59412025-02-21T10:06:16.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c530f77-e730-4712-8617-41eda8c9d00b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59422025-02-21T10:06:17.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 779ed43c-f65d-41e2-a791-ead1cebb8c0d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59432025-02-21T10:06:17.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 779ed43c-f65d-41e2-a791-ead1cebb8c0d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59442025-02-21T10:06:17.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 779ed43c-f65d-41e2-a791-ead1cebb8c0d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59452025-02-21T10:06:18.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f34161ff-e934-4c90-9e77-8c4800be7eed roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59462025-02-21T10:06:18.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f34161ff-e934-4c90-9e77-8c4800be7eed resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59472025-02-21T10:06:18.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f34161ff-e934-4c90-9e77-8c4800be7eed response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59482025-02-21T10:06:19.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9ae2ef9d-1a3c-4d5a-a3c9-ff488fae4eb6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59492025-02-21T10:06:19.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9ae2ef9d-1a3c-4d5a-a3c9-ff488fae4eb6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59502025-02-21T10:06:19.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9ae2ef9d-1a3c-4d5a-a3c9-ff488fae4eb6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59512025-02-21T10:06:20.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7acb2c71-89e2-4457-af08-5003be07f3e7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59522025-02-21T10:06:20.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7acb2c71-89e2-4457-af08-5003be07f3e7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59532025-02-21T10:06:20.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7acb2c71-89e2-4457-af08-5003be07f3e7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59542025-02-21T10:06:21.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3defe7dc-17d5-470a-80f5-83e49e774506 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59552025-02-21T10:06:21.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3defe7dc-17d5-470a-80f5-83e49e774506 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59562025-02-21T10:06:21.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3defe7dc-17d5-470a-80f5-83e49e774506 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59572025-02-21T10:06:22.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 525fa7fd-ad8c-4e30-bf30-d75edb98629d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
59582025-02-21T10:06:22.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 525fa7fd-ad8c-4e30-bf30-d75edb98629d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
59592025-02-21T10:06:22.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3488 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 525fa7fd-ad8c-4e30-bf30-d75edb98629d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
59602025-02-21T10:06:22.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9910a5a4-38b4-4316-9449-aa3d02c5ad0e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59612025-02-21T10:06:22.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9910a5a4-38b4-4316-9449-aa3d02c5ad0e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59622025-02-21T10:06:22.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9910a5a4-38b4-4316-9449-aa3d02c5ad0e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
59632025-02-21T10:06:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
59642025-02-21T10:06:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59652025-02-21T10:06:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
59662025-02-21T10:06:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
59672025-02-21T10:06:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59682025-02-21T10:06:23.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
59692025-02-21T10:06:23.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59702025-02-21T10:06:23.557ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
59712025-02-21T10:06:23.557ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
59722025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59732025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59742025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
59752025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
59762025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
59772025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59782025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
59792025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59802025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
59812025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
59822025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
59832025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
59842025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
59852025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59862025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
59872025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
59882025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59892025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
59902025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59912025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
59922025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59932025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59942025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
59952025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59962025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
59972025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59982025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
59992025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
60002025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60012025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
60022025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
60032025-02-21T10:06:23.558ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
60042025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60052025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
60062025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60072025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
60082025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
60092025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60102025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
60112025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
60122025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60132025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
60142025-02-21T10:06:23.558ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60152025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60162025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
60172025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60182025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
60192025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60202025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
60212025-02-21T10:06:23.558ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041
60222025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041"}
60232025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
60242025-02-21T10:06:23.558ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-21 09:56:23.558308939 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
60252025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
60262025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
60272025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
60282025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60292025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60302025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60312025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
60322025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60332025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60342025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60352025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60362025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60372025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60382025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60392025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60402025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60412025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60422025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60432025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60442025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60452025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60462025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60472025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60482025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60492025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60502025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60512025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60522025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60532025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60542025-02-21T10:06:23.558ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3bf841e1-42b9-4bd7-ac20-7644b8a83464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1581, tv_nsec: 856539656 } })
60552025-02-21T10:06:23.558ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d154e9e-6d90-4040-b311-004f0e299e85.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e63432d-4205-48df-bd2b-03a054e87ab0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1581, tv_nsec: 856568486 } })
60562025-02-21T10:06:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60572025-02-21T10:06:23.559ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
60582025-02-21T10:06:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.194458ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
60592025-02-21T10:06:23.559ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
60602025-02-21T10:06:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.547588ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
60612025-02-21T10:06:23.561ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60622025-02-21T10:06:23.561ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60632025-02-21T10:06:23.562ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.189741ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60642025-02-21T10:06:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
60652025-02-21T10:06:23.563ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60662025-02-21T10:06:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60672025-02-21T10:06:23.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60682025-02-21T10:06:23.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60692025-02-21T10:06:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60702025-02-21T10:06:23.566ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1581, tv_nsec: 863977045 } })
60712025-02-21T10:06:23.566ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
60722025-02-21T10:06:23.567ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.212792ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
60732025-02-21T10:06:23.567ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1581, tv_nsec: 865038041 } })
60742025-02-21T10:06:23.567ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
60752025-02-21T10:06:23.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60762025-02-21T10:06:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60772025-02-21T10:06:23.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60782025-02-21T10:06:23.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60792025-02-21T10:06:23.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60802025-02-21T10:06:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60812025-02-21T10:06:23.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60822025-02-21T10:06:23.609ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 51.709887ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
60832025-02-21T10:06:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60842025-02-21T10:06:23.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.966288ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
60852025-02-21T10:06:23.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.365388ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60862025-02-21T10:06:23.611ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-21 09:56:23.558308939 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
60872025-02-21T10:06:23.611ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 53.394858ms iteration = 9 status = {"expiration":"2025-02-21T09:56:23.558308939Z","pruned":[]}
60882025-02-21T10:06:23.611ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60892025-02-21T10:06:23.612ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
60902025-02-21T10:06:23.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60912025-02-21T10:06:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60922025-02-21T10:06:23.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.300371ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
60932025-02-21T10:06:23.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60942025-02-21T10:06:23.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60952025-02-21T10:06:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60962025-02-21T10:06:23.613ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60972025-02-21T10:06:23.614ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60982025-02-21T10:06:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60992025-02-21T10:06:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61002025-02-21T10:06:23.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61012025-02-21T10:06:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61022025-02-21T10:06:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61032025-02-21T10:06:23.617ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61042025-02-21T10:06:23.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61052025-02-21T10:06:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61062025-02-21T10:06:23.619ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61072025-02-21T10:06:23.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61082025-02-21T10:06:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61092025-02-21T10:06:23.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61102025-02-21T10:06:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61112025-02-21T10:06:23.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61122025-02-21T10:06:23.621ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61132025-02-21T10:06:23.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61142025-02-21T10:06:23.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61152025-02-21T10:06:23.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61162025-02-21T10:06:23.622ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61172025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61182025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61192025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61202025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
61212025-02-21T10:06:23.623ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
61222025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61232025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.143932ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
61242025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61252025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61262025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61272025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61282025-02-21T10:06:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61292025-02-21T10:06:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61302025-02-21T10:06:23.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61312025-02-21T10:06:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61322025-02-21T10:06:23.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61332025-02-21T10:06:23.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61342025-02-21T10:06:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61352025-02-21T10:06:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61362025-02-21T10:06:23.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61372025-02-21T10:06:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61382025-02-21T10:06:23.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61392025-02-21T10:06:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61402025-02-21T10:06:23.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61412025-02-21T10:06:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61422025-02-21T10:06:23.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61432025-02-21T10:06:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61442025-02-21T10:06:23.630ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1581, tv_nsec: 928190525 } })
61452025-02-21T10:06:23.630ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
61462025-02-21T10:06:23.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61472025-02-21T10:06:23.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61482025-02-21T10:06:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61492025-02-21T10:06:23.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61502025-02-21T10:06:23.637ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61512025-02-21T10:06:23.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61522025-02-21T10:06:23.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61532025-02-21T10:06:23.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
61542025-02-21T10:06:23.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61552025-02-21T10:06:23.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61562025-02-21T10:06:23.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61572025-02-21T10:06:23.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61582025-02-21T10:06:23.652ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
61592025-02-21T10:06:23.652ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 94.781627ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
61602025-02-21T10:06:23.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61612025-02-21T10:06:23.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
61622025-02-21T10:06:23.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.665667ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
61632025-02-21T10:06:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61642025-02-21T10:06:23.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61652025-02-21T10:06:23.662ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61662025-02-21T10:06:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61672025-02-21T10:06:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61682025-02-21T10:06:23.667ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61692025-02-21T10:06:23.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.79121ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
61702025-02-21T10:06:23.668ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61712025-02-21T10:06:23.668ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61722025-02-21T10:06:23.668ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 110.705742ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61732025-02-21T10:06:23.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61742025-02-21T10:06:23.669ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61752025-02-21T10:06:23.669ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61762025-02-21T10:06:23.669ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61772025-02-21T10:06:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61782025-02-21T10:06:23.669ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61792025-02-21T10:06:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61802025-02-21T10:06:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61812025-02-21T10:06:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61822025-02-21T10:06:23.670ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61832025-02-21T10:06:23.670ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.793682ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61842025-02-21T10:06:23.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61852025-02-21T10:06:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61862025-02-21T10:06:23.672ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61872025-02-21T10:06:23.672ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61882025-02-21T10:06:23.672ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.36917ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61892025-02-21T10:06:23.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61902025-02-21T10:06:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61912025-02-21T10:06:23.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61922025-02-21T10:06:23.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.013994ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61932025-02-21T10:06:23.676ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61942025-02-21T10:06:23.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61952025-02-21T10:06:23.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61962025-02-21T10:06:23.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.916991ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61972025-02-21T10:06:23.706ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61982025-02-21T10:06:23.706ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61992025-02-21T10:06:23.706ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
62002025-02-21T10:06:23.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62012025-02-21T10:06:23.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62022025-02-21T10:06:23.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62032025-02-21T10:06:23.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62042025-02-21T10:06:23.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62052025-02-21T10:06:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62062025-02-21T10:06:23.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62072025-02-21T10:06:23.711ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62082025-02-21T10:06:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62092025-02-21T10:06:23.713ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
62102025-02-21T10:06:23.713ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
62112025-02-21T10:06:23.713ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
62122025-02-21T10:06:23.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62132025-02-21T10:06:23.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62142025-02-21T10:06:23.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62152025-02-21T10:06:23.716ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
62162025-02-21T10:06:23.716ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 158.930746ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
62172025-02-21T10:06:23.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62182025-02-21T10:06:23.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62192025-02-21T10:06:23.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62202025-02-21T10:06:23.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62212025-02-21T10:06:23.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
62222025-02-21T10:06:23.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62232025-02-21T10:06:23.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62242025-02-21T10:06:23.724ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 166.009817ms iteration = 17 status = 0
62252025-02-21T10:06:23.739ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-21T09:58:18.895783Z, time_modified: 2025-02-21T09:58:18.895783Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }) }
62262025-02-21T10:06:23.739ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 181.891521ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]}},"default_endpoint":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62272025-02-21T10:06:23.742ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62282025-02-21T10:06:23.742ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 0 version = 2
62292025-02-21T10:06:23.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62302025-02-21T10:06:23.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62312025-02-21T10:06:23.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62322025-02-21T10:06:23.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62332025-02-21T10:06:23.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62342025-02-21T10:06:23.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62352025-02-21T10:06:23.748ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
62362025-02-21T10:06:23.748ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62372025-02-21T10:06:23.749ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "109957ac-1732-4959-83b0-aac7c57ee110", "content-length": "26", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
62382025-02-21T10:06:23.749ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62392025-02-21T10:06:23.749ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62402025-02-21T10:06:23.749ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62412025-02-21T10:06:23.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62422025-02-21T10:06:23.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62432025-02-21T10:06:23.749ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 1 version = 2
62442025-02-21T10:06:23.749ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62452025-02-21T10:06:23.749ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-21 09:58:29.727106 UTC dns_group = external generation = 2
62462025-02-21T10:06:23.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 191.259247ms iteration = 9 status = {"generation":2}
62472025-02-21T10:06:23.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62482025-02-21T10:06:23.751ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62492025-02-21T10:06:23.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62502025-02-21T10:06:23.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62512025-02-21T10:06:23.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62522025-02-21T10:06:23.756ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
62532025-02-21T10:06:23.756ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62542025-02-21T10:06:23.756ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-21 09:58:29.164998 UTC dns_group = internal generation = 1
62552025-02-21T10:06:23.756ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 198.341658ms iteration = 9 status = {"generation":1}
62562025-02-21T10:06:23.765ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 207.54338ms iteration = 19 status = {"physical_disks_added":0}
62572025-02-21T10:06:23.804ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62582025-02-21T10:06:23.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62592025-02-21T10:06:23.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62602025-02-21T10:06:23.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62612025-02-21T10:06:23.811ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
62622025-02-21T10:06:23.811ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62632025-02-21T10:06:23.812ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36129356-b9ed-47e0-8301-df5daba7b628", "content-length": "26", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
62642025-02-21T10:06:23.812ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62652025-02-21T10:06:23.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62662025-02-21T10:06:23.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62672025-02-21T10:06:23.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62682025-02-21T10:06:23.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62692025-02-21T10:06:23.814ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
62702025-02-21T10:06:23.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62712025-02-21T10:06:23.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62722025-02-21T10:06:23.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62732025-02-21T10:06:23.867ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
62742025-02-21T10:06:23.867ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62752025-02-21T10:06:23.867ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0180aac7-ff11-41bd-b0a9-119d8c805984", "content-length": "26", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
62762025-02-21T10:06:23.867ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62772025-02-21T10:06:23.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62782025-02-21T10:06:23.910ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62792025-02-21T10:06:23.910ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62802025-02-21T10:06:23.911ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cad3b887-0406-4549-9b58-e6b7b2184dc1", "content-length": "372", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
62812025-02-21T10:06:23.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62822025-02-21T10:06:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62832025-02-21T10:06:23.949ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 391.021679ms iteration = 17 status = {}
62842025-02-21T10:06:23.953ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
62852025-02-21T10:06:23.953ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62862025-02-21T10:06:23.953ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "89bae0c2-b5d5-4925-99f0-9548a688a71d", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
62872025-02-21T10:06:23.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62882025-02-21T10:06:23.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62892025-02-21T10:06:23.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62902025-02-21T10:06:23.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62912025-02-21T10:06:23.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62922025-02-21T10:06:23.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62932025-02-21T10:06:23.961ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62942025-02-21T10:06:23.961ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62952025-02-21T10:06:23.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9539740c-a414-44a7-b0ac-ac51202e0974", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
62962025-02-21T10:06:23.964ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 405.802856ms iteration = 17 status = {}
62972025-02-21T10:06:23.972ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62982025-02-21T10:06:23.987ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62992025-02-21T10:06:23.987ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b196202-7427-49d4-a16a-691f16812e22", "content-length": "691", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
63002025-02-21T10:06:23.987ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
63012025-02-21T10:06:23.987ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
63022025-02-21T10:06:23.987ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
63032025-02-21T10:06:23.990ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 431.726922ms iteration = 17 status = {}
63042025-02-21T10:06:23.998ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63052025-02-21T10:06:23.998ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "95ede83c-13e9-4405-bb2d-dcc652c1b8d0", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63062025-02-21T10:06:23.998ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63072025-02-21T10:06:24.001ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8500b412-8d01-498a-a312-3e19b19f5f27", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63082025-02-21T10:06:24.001ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63092025-02-21T10:06:24.003ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63102025-02-21T10:06:24.003ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 445.531665ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63112025-02-21T10:06:24.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 10e7f006-ff07-47ce-aef8-5876041ef585 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63122025-02-21T10:06:24.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 10e7f006-ff07-47ce-aef8-5876041ef585 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63132025-02-21T10:06:24.016ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63142025-02-21T10:06:24.017ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d6b2f11-537e-47a4-954d-52c8dc3bcd6c", "content-length": "1", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
63152025-02-21T10:06:24.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 10e7f006-ff07-47ce-aef8-5876041ef585 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63162025-02-21T10:06:24.019ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63172025-02-21T10:06:24.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63182025-02-21T10:06:24.020ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 462.730171ms iteration = 17 status = null
63192025-02-21T10:06:24.126ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63202025-02-21T10:06:24.127ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9ad2d5a9-4cab-4821-8a23-d19e1d32ff1c", "date": "Fri, 21 Feb 2025 10:06:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63212025-02-21T10:06:24.127ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63222025-02-21T10:06:24.129ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a358483f-ee63-4a9c-9478-e5cb03ac4f47", "date": "Fri, 21 Feb 2025 10:06:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63232025-02-21T10:06:24.129ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63242025-02-21T10:06:24.130ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "97112c68-abe1-480e-99f3-f5d841cd21b9", "date": "Fri, 21 Feb 2025 10:06:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63252025-02-21T10:06:24.130ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63262025-02-21T10:06:24.132ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63272025-02-21T10:06:24.132ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 573.995237ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
63282025-02-21T10:06:24.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63292025-02-21T10:06:24.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63302025-02-21T10:06:24.176ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
63312025-02-21T10:06:24.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63322025-02-21T10:06:24.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63332025-02-21T10:06:24.186ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63342025-02-21T10:06:24.186ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0738e1ce-c55e-4f2a-bef7-88ca26cebde0", "content-length": "134", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
63352025-02-21T10:06:24.186ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63362025-02-21T10:06:24.186ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
63372025-02-21T10:06:24.186ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63382025-02-21T10:06:24.186ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63392025-02-21T10:06:24.186ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63402025-02-21T10:06:24.186ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63412025-02-21T10:06:24.186ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63422025-02-21T10:06:24.186ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63432025-02-21T10:06:24.187ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63442025-02-21T10:06:24.187ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63452025-02-21T10:06:24.187ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
63462025-02-21T10:06:24.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63472025-02-21T10:06:24.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63482025-02-21T10:06:24.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63492025-02-21T10:06:24.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "740024ff-baaf-4cd2-9f83-9000ce5e9405", "content-length": "2", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
63502025-02-21T10:06:24.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63512025-02-21T10:06:24.189ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd90414f-9ae9-432a-a974-0a6ad7aa0da8", "content-length": "52", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
63522025-02-21T10:06:24.189ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
63532025-02-21T10:06:24.189ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63542025-02-21T10:06:24.293ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a7dcd381-03ef-4132-ab77-4e1a9541e603", "date": "Fri, 21 Feb 2025 10:06:23 GMT"} })
63552025-02-21T10:06:24.293ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
63562025-02-21T10:06:24.293ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63572025-02-21T10:06:24.293ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "83dc6d11-7e07-4922-9b2e-173f60b5bcf1", "content-length": "682", "date": "Fri, 21 Feb 2025 10:06:24 GMT"} })
63582025-02-21T10:06:24.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63592025-02-21T10:06:24.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63602025-02-21T10:06:24.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63612025-02-21T10:06:24.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63622025-02-21T10:06:24.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63632025-02-21T10:06:24.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63642025-02-21T10:06:24.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63652025-02-21T10:06:24.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63662025-02-21T10:06:24.313ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 755.469137ms iteration = 17 status = {}
63672025-02-21T10:06:25.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 07b0dea2-6d05-4b75-ba24-6cb119057b75 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63682025-02-21T10:06:25.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 07b0dea2-6d05-4b75-ba24-6cb119057b75 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63692025-02-21T10:06:25.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1896 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 07b0dea2-6d05-4b75-ba24-6cb119057b75 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63702025-02-21T10:06:26.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 04d7e975-bc55-490a-b7b9-de0d1fb32595 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63712025-02-21T10:06:26.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 04d7e975-bc55-490a-b7b9-de0d1fb32595 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63722025-02-21T10:06:26.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 04d7e975-bc55-490a-b7b9-de0d1fb32595 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63732025-02-21T10:06:26.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 847 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = c0701aee-79b3-4e7b-8bea-0fd95d9fd664 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
63742025-02-21T10:06:27.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29a27d75-1ee3-4b1c-89d4-8710eb9f6f76 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63752025-02-21T10:06:27.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29a27d75-1ee3-4b1c-89d4-8710eb9f6f76 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63762025-02-21T10:06:27.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1888 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29a27d75-1ee3-4b1c-89d4-8710eb9f6f76 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63772025-02-21T10:06:28.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a8c201e1-29ef-4042-a878-21d3a423da23 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63782025-02-21T10:06:28.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a8c201e1-29ef-4042-a878-21d3a423da23 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63792025-02-21T10:06:28.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a8c201e1-29ef-4042-a878-21d3a423da23 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63802025-02-21T10:06:29.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d687edbd-5c83-4265-b69e-7c418874022a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63812025-02-21T10:06:29.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d687edbd-5c83-4265-b69e-7c418874022a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63822025-02-21T10:06:29.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2851 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d687edbd-5c83-4265-b69e-7c418874022a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63832025-02-21T10:06:30.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2de7a3c2-3825-48ea-9286-0cb5285c30c5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63842025-02-21T10:06:30.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2de7a3c2-3825-48ea-9286-0cb5285c30c5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63852025-02-21T10:06:30.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2de7a3c2-3825-48ea-9286-0cb5285c30c5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63862025-02-21T10:06:31.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30c52241-436a-4f81-a0ec-8ba35e489490 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63872025-02-21T10:06:31.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30c52241-436a-4f81-a0ec-8ba35e489490 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63882025-02-21T10:06:31.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30c52241-436a-4f81-a0ec-8ba35e489490 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63892025-02-21T10:06:32.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 482c8399-925c-4ab2-aad2-0f0a5e5eccb6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63902025-02-21T10:06:32.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 482c8399-925c-4ab2-aad2-0f0a5e5eccb6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63912025-02-21T10:06:32.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1836 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 482c8399-925c-4ab2-aad2-0f0a5e5eccb6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63922025-02-21T10:06:33.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a0f029c9-f6ed-4865-9a5f-ce4ba363413e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63932025-02-21T10:06:33.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a0f029c9-f6ed-4865-9a5f-ce4ba363413e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63942025-02-21T10:06:33.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a0f029c9-f6ed-4865-9a5f-ce4ba363413e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
63952025-02-21T10:06:33.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
63962025-02-21T10:06:33.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
63972025-02-21T10:06:33.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63982025-02-21T10:06:33.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63992025-02-21T10:06:33.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64002025-02-21T10:06:33.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64012025-02-21T10:06:33.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64022025-02-21T10:06:33.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64032025-02-21T10:06:33.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64042025-02-21T10:06:33.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64052025-02-21T10:06:33.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64062025-02-21T10:06:33.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64072025-02-21T10:06:33.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64082025-02-21T10:06:33.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
64092025-02-21T10:06:33.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64102025-02-21T10:06:33.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64112025-02-21T10:06:33.581ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
64122025-02-21T10:06:33.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.075376ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
64132025-02-21T10:06:33.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64142025-02-21T10:06:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64152025-02-21T10:06:33.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.770626ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64162025-02-21T10:06:34.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c67638f-219a-407e-930b-045f8cfe7ce4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64172025-02-21T10:06:34.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c67638f-219a-407e-930b-045f8cfe7ce4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64182025-02-21T10:06:34.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5c67638f-219a-407e-930b-045f8cfe7ce4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64192025-02-21T10:06:35.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6e1d6f62-0acf-42f3-84f8-5bacfa6de446 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64202025-02-21T10:06:35.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6e1d6f62-0acf-42f3-84f8-5bacfa6de446 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64212025-02-21T10:06:35.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6e1d6f62-0acf-42f3-84f8-5bacfa6de446 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64222025-02-21T10:06:36.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ee14bc61-25ea-4bf7-8c88-bdd2f1fb2435 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64232025-02-21T10:06:36.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ee14bc61-25ea-4bf7-8c88-bdd2f1fb2435 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64242025-02-21T10:06:36.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1822 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ee14bc61-25ea-4bf7-8c88-bdd2f1fb2435 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64252025-02-21T10:06:36.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 554 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 55dc43cd-3fd3-42dc-8bb8-554734e4d99c response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
64262025-02-21T10:06:37.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f28db15a-83a4-4688-a00b-3f3ab66b286b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64272025-02-21T10:06:37.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f28db15a-83a4-4688-a00b-3f3ab66b286b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64282025-02-21T10:06:37.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3152 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f28db15a-83a4-4688-a00b-3f3ab66b286b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64292025-02-21T10:06:38.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6738b62e-b819-4c33-bb16-daa41de8ead5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64302025-02-21T10:06:38.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6738b62e-b819-4c33-bb16-daa41de8ead5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64312025-02-21T10:06:38.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6738b62e-b819-4c33-bb16-daa41de8ead5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64322025-02-21T10:06:39.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6dcdba7b-f856-4b93-a18d-c1d6ff934656 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64332025-02-21T10:06:39.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6dcdba7b-f856-4b93-a18d-c1d6ff934656 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64342025-02-21T10:06:39.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6dcdba7b-f856-4b93-a18d-c1d6ff934656 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64352025-02-21T10:06:40.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0f5b4ec2-179d-4403-bb05-efe0b57ee3fa roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64362025-02-21T10:06:40.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0f5b4ec2-179d-4403-bb05-efe0b57ee3fa resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64372025-02-21T10:06:40.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0f5b4ec2-179d-4403-bb05-efe0b57ee3fa response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64382025-02-21T10:06:41.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bf7bb9b8-4e37-461d-b4cb-b684eeebdf71 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64392025-02-21T10:06:41.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bf7bb9b8-4e37-461d-b4cb-b684eeebdf71 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64402025-02-21T10:06:41.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bf7bb9b8-4e37-461d-b4cb-b684eeebdf71 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64412025-02-21T10:06:42.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 12507d1c-6d1d-4311-96be-47de57d9dc16 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64422025-02-21T10:06:42.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 12507d1c-6d1d-4311-96be-47de57d9dc16 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64432025-02-21T10:06:42.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1939 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 12507d1c-6d1d-4311-96be-47de57d9dc16 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64442025-02-21T10:06:43.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a4984e39-f838-488e-9f28-a18bd293be7e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64452025-02-21T10:06:43.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a4984e39-f838-488e-9f28-a18bd293be7e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64462025-02-21T10:06:43.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a4984e39-f838-488e-9f28-a18bd293be7e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64472025-02-21T10:06:43.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
64482025-02-21T10:06:43.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
64492025-02-21T10:06:43.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64502025-02-21T10:06:43.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64512025-02-21T10:06:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64522025-02-21T10:06:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64532025-02-21T10:06:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64542025-02-21T10:06:43.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64552025-02-21T10:06:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64562025-02-21T10:06:43.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.15578ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64572025-02-21T10:06:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64582025-02-21T10:06:43.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64592025-02-21T10:06:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64602025-02-21T10:06:43.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64612025-02-21T10:06:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64622025-02-21T10:06:43.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64632025-02-21T10:06:43.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
64642025-02-21T10:06:43.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64652025-02-21T10:06:43.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64662025-02-21T10:06:43.579ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
64672025-02-21T10:06:43.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.758255ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
64682025-02-21T10:06:44.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c5e667b1-d7d7-4666-aa0f-fc6987de96e0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64692025-02-21T10:06:44.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c5e667b1-d7d7-4666-aa0f-fc6987de96e0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64702025-02-21T10:06:44.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c5e667b1-d7d7-4666-aa0f-fc6987de96e0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64712025-02-21T10:06:45.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9a4e755b-0564-4df2-b17c-6540597387e3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64722025-02-21T10:06:45.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9a4e755b-0564-4df2-b17c-6540597387e3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64732025-02-21T10:06:45.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9a4e755b-0564-4df2-b17c-6540597387e3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64742025-02-21T10:06:46.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f8fbb74a-dee5-4f90-9765-671a920312e2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64752025-02-21T10:06:46.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f8fbb74a-dee5-4f90-9765-671a920312e2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64762025-02-21T10:06:46.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f8fbb74a-dee5-4f90-9765-671a920312e2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64772025-02-21T10:06:46.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 477 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = ff271160-e234-49fe-b778-71d9a3592dd6 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
64782025-02-21T10:06:47.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5bc99aae-476d-43f1-beb7-ae67d9cc897b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64792025-02-21T10:06:47.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5bc99aae-476d-43f1-beb7-ae67d9cc897b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64802025-02-21T10:06:47.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1927 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5bc99aae-476d-43f1-beb7-ae67d9cc897b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64812025-02-21T10:06:48.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3ca2263d-183f-4f34-b579-bfc3e8253df9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64822025-02-21T10:06:48.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3ca2263d-183f-4f34-b579-bfc3e8253df9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64832025-02-21T10:06:48.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3ca2263d-183f-4f34-b579-bfc3e8253df9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64842025-02-21T10:06:49.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ce55feda-c767-417e-8c9a-f9beb76041f1 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64852025-02-21T10:06:49.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ce55feda-c767-417e-8c9a-f9beb76041f1 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64862025-02-21T10:06:49.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ce55feda-c767-417e-8c9a-f9beb76041f1 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64872025-02-21T10:06:50.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb3ce6aa-a9b1-4abe-b582-9c879a4014ce roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64882025-02-21T10:06:50.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb3ce6aa-a9b1-4abe-b582-9c879a4014ce resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64892025-02-21T10:06:50.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1825 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb3ce6aa-a9b1-4abe-b582-9c879a4014ce response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64902025-02-21T10:06:51.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eafb2b81-76b5-4ce2-ae72-9a7a992dba71 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64912025-02-21T10:06:51.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eafb2b81-76b5-4ce2-ae72-9a7a992dba71 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64922025-02-21T10:06:51.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eafb2b81-76b5-4ce2-ae72-9a7a992dba71 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64932025-02-21T10:06:52.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 819c5929-128f-4ae4-b073-6dd4110454e2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64942025-02-21T10:06:52.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 819c5929-128f-4ae4-b073-6dd4110454e2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64952025-02-21T10:06:52.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3683 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 819c5929-128f-4ae4-b073-6dd4110454e2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64962025-02-21T10:06:52.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 802cc0b9-aae1-47bd-9614-1700e68137b0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64972025-02-21T10:06:52.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 802cc0b9-aae1-47bd-9614-1700e68137b0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64982025-02-21T10:06:52.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 802cc0b9-aae1-47bd-9614-1700e68137b0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
64992025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
65002025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65012025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
65022025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65032025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
65042025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65052025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65062025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
65072025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
65082025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65092025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
65102025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65112025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
65122025-02-21T10:06:53.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65132025-02-21T10:06:53.558ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65142025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
65152025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65162025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
65172025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65182025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65192025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
65202025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
65212025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
65222025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65232025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
65242025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65252025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
65262025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65272025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
65282025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65292025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
65302025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65312025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
65322025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65332025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
65342025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
65352025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65362025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
65372025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65382025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65392025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65402025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65412025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65422025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65432025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65442025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65452025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65462025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65472025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65482025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65492025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65502025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
65512025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65522025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65532025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65542025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65552025-02-21T10:06:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65562025-02-21T10:06:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65572025-02-21T10:06:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65582025-02-21T10:06:53.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65592025-02-21T10:06:53.562ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.398987ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65602025-02-21T10:06:53.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65612025-02-21T10:06:53.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65622025-02-21T10:06:53.563ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65632025-02-21T10:06:53.563ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65642025-02-21T10:06:53.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65652025-02-21T10:06:53.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65662025-02-21T10:06:53.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65672025-02-21T10:06:53.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65682025-02-21T10:06:53.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65692025-02-21T10:06:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65702025-02-21T10:06:53.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65712025-02-21T10:06:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65722025-02-21T10:06:53.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65732025-02-21T10:06:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65742025-02-21T10:06:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65752025-02-21T10:06:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65762025-02-21T10:06:53.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65772025-02-21T10:06:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65782025-02-21T10:06:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65792025-02-21T10:06:53.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65802025-02-21T10:06:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65812025-02-21T10:06:53.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65822025-02-21T10:06:53.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.812787ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
65832025-02-21T10:06:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65842025-02-21T10:06:53.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65852025-02-21T10:06:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65862025-02-21T10:06:53.570ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 12.736097ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
65872025-02-21T10:06:53.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.447814ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
65882025-02-21T10:06:53.571ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65892025-02-21T10:06:53.571ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1611, tv_nsec: 869534549 } })
65902025-02-21T10:06:53.571ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1611, tv_nsec: 869586520 } })
65912025-02-21T10:06:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65922025-02-21T10:06:53.571ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
65932025-02-21T10:06:53.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65942025-02-21T10:06:53.572ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
65952025-02-21T10:06:53.572ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65962025-02-21T10:06:53.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.003442ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65972025-02-21T10:06:53.573ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 15.886923ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65982025-02-21T10:06:53.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65992025-02-21T10:06:53.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66002025-02-21T10:06:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66012025-02-21T10:06:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
66022025-02-21T10:06:53.574ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66032025-02-21T10:06:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66042025-02-21T10:06:53.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66052025-02-21T10:06:53.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66062025-02-21T10:06:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66072025-02-21T10:06:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66082025-02-21T10:06:53.577ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1611, tv_nsec: 875245557 } })
66092025-02-21T10:06:53.577ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
66102025-02-21T10:06:53.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66112025-02-21T10:06:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66122025-02-21T10:06:53.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66132025-02-21T10:06:53.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66142025-02-21T10:06:53.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66152025-02-21T10:06:53.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66162025-02-21T10:06:53.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66172025-02-21T10:06:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66182025-02-21T10:06:53.580ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66192025-02-21T10:06:53.580ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.990285ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66202025-02-21T10:06:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66212025-02-21T10:06:53.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66222025-02-21T10:06:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66232025-02-21T10:06:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
66242025-02-21T10:06:53.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66252025-02-21T10:06:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66262025-02-21T10:06:53.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
66272025-02-21T10:06:53.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.470096ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
66282025-02-21T10:06:53.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66292025-02-21T10:06:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66302025-02-21T10:06:53.604ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66312025-02-21T10:06:53.604ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66322025-02-21T10:06:53.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66332025-02-21T10:06:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66342025-02-21T10:06:53.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66352025-02-21T10:06:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66362025-02-21T10:06:53.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66372025-02-21T10:06:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66382025-02-21T10:06:53.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66392025-02-21T10:06:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66402025-02-21T10:06:53.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66412025-02-21T10:06:53.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
66422025-02-21T10:06:53.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66432025-02-21T10:06:53.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66442025-02-21T10:06:53.614ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.109474ms iteration = 18 status = 0
66452025-02-21T10:06:53.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 60.324956ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66462025-02-21T10:06:53.621ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66472025-02-21T10:06:53.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66482025-02-21T10:06:53.623ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66492025-02-21T10:06:53.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
66502025-02-21T10:06:53.625ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66512025-02-21T10:06:53.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66522025-02-21T10:06:53.626ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
66532025-02-21T10:06:53.626ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 68.726198ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
66542025-02-21T10:06:53.649ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66552025-02-21T10:06:53.649ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66562025-02-21T10:06:53.649ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 91.896308ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66572025-02-21T10:06:53.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.684537ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
66582025-02-21T10:06:53.668ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
66592025-02-21T10:06:53.668ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66602025-02-21T10:06:53.668ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50fa6de5-b611-45d6-806d-fffb6d980658", "content-length": "26", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
66612025-02-21T10:06:53.668ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66622025-02-21T10:06:53.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a9c7feef-d22b-466d-ad63-653810aef7c0 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
66632025-02-21T10:06:53.670ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66642025-02-21T10:06:53.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a9c7feef-d22b-466d-ad63-653810aef7c0 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
66652025-02-21T10:06:53.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2079 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a9c7feef-d22b-466d-ad63-653810aef7c0 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
66662025-02-21T10:06:53.673ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
66672025-02-21T10:06:53.673ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66682025-02-21T10:06:53.673ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a16e149-74ac-4d53-b0ee-f0b23aeb0264", "content-length": "26", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
66692025-02-21T10:06:53.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66702025-02-21T10:06:53.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66712025-02-21T10:06:53.688ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.712456ms iteration = 20 status = {"physical_disks_added":0}
66722025-02-21T10:06:53.689ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66732025-02-21T10:06:53.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66742025-02-21T10:06:53.695ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
66752025-02-21T10:06:53.695ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66762025-02-21T10:06:53.728ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b34a3309-acb6-40f6-8ead-fba5bb4c3def", "content-length": "26", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
66772025-02-21T10:06:53.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66782025-02-21T10:06:53.730ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
66792025-02-21T10:06:53.785ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 226.896657ms iteration = 18 status = {}
66802025-02-21T10:06:53.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66812025-02-21T10:06:53.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66822025-02-21T10:06:53.791ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66832025-02-21T10:06:53.791ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66842025-02-21T10:06:53.791ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3dc437f-8b7c-4df0-9e9f-46f09f57f214", "content-length": "372", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
66852025-02-21T10:06:53.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66862025-02-21T10:06:53.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66872025-02-21T10:06:53.792ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66882025-02-21T10:06:53.792ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "60a981c4-f6da-4f28-bea8-83219a7667c2", "content-length": "1", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
66892025-02-21T10:06:53.794ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66902025-02-21T10:06:53.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66912025-02-21T10:06:53.797ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 238.878817ms iteration = 18 status = null
66922025-02-21T10:06:53.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66932025-02-21T10:06:53.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66942025-02-21T10:06:53.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66952025-02-21T10:06:53.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66962025-02-21T10:06:53.838ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
66972025-02-21T10:06:53.838ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66982025-02-21T10:06:53.838ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3b662444-0618-4b3b-ab47-8e659d7571fc", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
66992025-02-21T10:06:53.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67002025-02-21T10:06:53.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67012025-02-21T10:06:53.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67022025-02-21T10:06:53.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67032025-02-21T10:06:53.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67042025-02-21T10:06:53.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67052025-02-21T10:06:53.847ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67062025-02-21T10:06:53.847ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67072025-02-21T10:06:53.847ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cef6e350-e7fc-4471-8c7b-7cebba5d535e", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
67082025-02-21T10:06:53.849ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.787224ms iteration = 18 status = {}
67092025-02-21T10:06:53.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67102025-02-21T10:06:53.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67112025-02-21T10:06:53.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67122025-02-21T10:06:53.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67132025-02-21T10:06:53.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67142025-02-21T10:06:53.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67152025-02-21T10:06:53.871ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
67162025-02-21T10:06:53.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67172025-02-21T10:06:53.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67182025-02-21T10:06:53.882ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67192025-02-21T10:06:53.883ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c858c031-6954-4436-b639-9c746b6c750b", "content-length": "134", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
67202025-02-21T10:06:53.883ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67212025-02-21T10:06:53.883ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
67222025-02-21T10:06:53.883ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67232025-02-21T10:06:53.883ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67242025-02-21T10:06:53.883ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67252025-02-21T10:06:53.883ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67262025-02-21T10:06:53.883ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67272025-02-21T10:06:53.883ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67282025-02-21T10:06:53.883ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67292025-02-21T10:06:53.883ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67302025-02-21T10:06:53.884ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
67312025-02-21T10:06:53.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67322025-02-21T10:06:53.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67332025-02-21T10:06:53.886ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67342025-02-21T10:06:53.886ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ea64fe2-b2e1-4670-af79-b0b7e6a6bf37", "content-length": "2", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
67352025-02-21T10:06:53.886ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67362025-02-21T10:06:53.886ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ac30dfe-88eb-4a98-8a75-a05c6ad3e703", "content-length": "52", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
67372025-02-21T10:06:53.886ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
67382025-02-21T10:06:53.886ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67392025-02-21T10:06:53.947ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67402025-02-21T10:06:53.987ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bdfc399a-bd06-4260-99d9-856c531d8755", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
67412025-02-21T10:06:53.987ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
67422025-02-21T10:06:53.987ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67432025-02-21T10:06:53.987ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d867e9a-e36a-4ba3-b9a4-34172c823693", "content-length": "691", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
67442025-02-21T10:06:53.987ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67452025-02-21T10:06:53.987ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
67462025-02-21T10:06:53.987ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
67472025-02-21T10:06:53.987ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc265c54-8c95-405b-95e9-945c9e5f3182", "content-length": "682", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
67482025-02-21T10:06:53.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67492025-02-21T10:06:53.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67502025-02-21T10:06:53.988ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 430.709227ms iteration = 18 status = {}
67512025-02-21T10:06:53.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67522025-02-21T10:06:53.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67532025-02-21T10:06:53.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67542025-02-21T10:06:53.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67552025-02-21T10:06:53.997ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67562025-02-21T10:06:53.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67572025-02-21T10:06:54.004ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 446.466109ms iteration = 18 status = {}
67582025-02-21T10:06:54.269ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
67592025-02-21T10:06:54.270ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
67602025-02-21T10:06:54.301ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
67612025-02-21T10:06:54.301ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:54272
67622025-02-21T10:06:54.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54272 req_id = b127d6c2-4473-418b-a0b2-bf55cfdf4271 roles = RoleSet { roles: {} } uri = /metrics/producers
67632025-02-21T10:06:54.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54272 req_id = b127d6c2-4473-418b-a0b2-bf55cfdf4271 resource = Database result = Ok(()) uri = /metrics/producers
67642025-02-21T10:06:54.344ZINFOnexus: assigned collector to new producer collector_id = 8d248760-b8d2-4503-94cf-92f282d79332 file = nexus/src/app/oximeter.rs:76 producer_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
67652025-02-21T10:06:54.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 42583 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54272 req_id = b127d6c2-4473-418b-a0b2-bf55cfdf4271 response_code = 201 uri = /metrics/producers
67662025-02-21T10:06:54.344ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b127d6c2-4473-418b-a0b2-bf55cfdf4271", "content-length": "41", "date": "Fri, 21 Feb 2025 10:06:53 GMT"} })
67672025-02-21T10:06:54.346ZDEBGnexus (producer-registration-task): registered with nexus successfully
67682025-02-21T10:06:54.346ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
67692025-02-21T10:06:54.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 45a074a1-c607-421a-817d-e58204ce1b2d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67702025-02-21T10:06:54.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 45a074a1-c607-421a-817d-e58204ce1b2d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67712025-02-21T10:06:54.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1987 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 45a074a1-c607-421a-817d-e58204ce1b2d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67722025-02-21T10:06:55.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8639d586-966e-4ed7-be85-75aa9e517c7c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67732025-02-21T10:06:55.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8639d586-966e-4ed7-be85-75aa9e517c7c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67742025-02-21T10:06:55.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8639d586-966e-4ed7-be85-75aa9e517c7c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67752025-02-21T10:06:56.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 552 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = b1a0cec0-a975-4bbe-923c-0bf0167bb5a3 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
67762025-02-21T10:06:56.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dbdbbe9c-c202-4971-9168-466bc569a54b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67772025-02-21T10:06:56.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dbdbbe9c-c202-4971-9168-466bc569a54b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67782025-02-21T10:06:56.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2568 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dbdbbe9c-c202-4971-9168-466bc569a54b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67792025-02-21T10:06:57.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 01a2b268-8eab-4ff4-8fd9-03862732aac8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67802025-02-21T10:06:57.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 01a2b268-8eab-4ff4-8fd9-03862732aac8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67812025-02-21T10:06:57.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 01a2b268-8eab-4ff4-8fd9-03862732aac8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67822025-02-21T10:06:58.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6891bf1a-790a-4e30-baae-34f179bcc495 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67832025-02-21T10:06:58.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6891bf1a-790a-4e30-baae-34f179bcc495 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67842025-02-21T10:06:58.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6891bf1a-790a-4e30-baae-34f179bcc495 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67852025-02-21T10:06:59.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 40bdf608-d774-4edd-8d4d-5b30bc4ede66 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67862025-02-21T10:06:59.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 40bdf608-d774-4edd-8d4d-5b30bc4ede66 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67872025-02-21T10:06:59.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1614 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 40bdf608-d774-4edd-8d4d-5b30bc4ede66 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67882025-02-21T10:07:00.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fb442d39-9bd2-4425-bbac-a528e549b603 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67892025-02-21T10:07:00.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fb442d39-9bd2-4425-bbac-a528e549b603 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67902025-02-21T10:07:00.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fb442d39-9bd2-4425-bbac-a528e549b603 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67912025-02-21T10:07:01.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 894af386-787d-43cf-bcc1-0084b6a63f51 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67922025-02-21T10:07:01.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 894af386-787d-43cf-bcc1-0084b6a63f51 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67932025-02-21T10:07:01.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 894af386-787d-43cf-bcc1-0084b6a63f51 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67942025-02-21T10:07:02.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e1284d82-02de-40f5-9cc0-6afbbb14506e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67952025-02-21T10:07:02.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e1284d82-02de-40f5-9cc0-6afbbb14506e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67962025-02-21T10:07:02.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e1284d82-02de-40f5-9cc0-6afbbb14506e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
67972025-02-21T10:07:03.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
67982025-02-21T10:07:03.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67992025-02-21T10:07:03.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
68002025-02-21T10:07:03.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68012025-02-21T10:07:03.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68022025-02-21T10:07:03.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68032025-02-21T10:07:03.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68042025-02-21T10:07:03.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68052025-02-21T10:07:03.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68062025-02-21T10:07:03.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68072025-02-21T10:07:03.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68082025-02-21T10:07:03.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68092025-02-21T10:07:03.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68102025-02-21T10:07:03.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
68112025-02-21T10:07:03.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68122025-02-21T10:07:03.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68132025-02-21T10:07:03.581ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
68142025-02-21T10:07:03.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.23367ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
68152025-02-21T10:07:03.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68162025-02-21T10:07:03.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68172025-02-21T10:07:03.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.619045ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68182025-02-21T10:07:03.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 09e3503c-0a24-4998-ac15-4b70925eefa5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68192025-02-21T10:07:03.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 09e3503c-0a24-4998-ac15-4b70925eefa5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68202025-02-21T10:07:03.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1747 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 09e3503c-0a24-4998-ac15-4b70925eefa5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68212025-02-21T10:07:04.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b8cd7003-f29a-4872-b2e1-19e1e38318bb roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68222025-02-21T10:07:04.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b8cd7003-f29a-4872-b2e1-19e1e38318bb resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68232025-02-21T10:07:04.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b8cd7003-f29a-4872-b2e1-19e1e38318bb response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68242025-02-21T10:07:05.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 156f2c16-f483-4b53-92c0-35764548b7be roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68252025-02-21T10:07:05.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 156f2c16-f483-4b53-92c0-35764548b7be resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68262025-02-21T10:07:05.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1967 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 156f2c16-f483-4b53-92c0-35764548b7be response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68272025-02-21T10:07:06.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 498 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = d2567182-8a81-45df-a935-ba9ec50c3671 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
68282025-02-21T10:07:06.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7cbb4edc-3e3d-425e-a15e-2bb88a94c0b2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68292025-02-21T10:07:06.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7cbb4edc-3e3d-425e-a15e-2bb88a94c0b2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68302025-02-21T10:07:06.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7cbb4edc-3e3d-425e-a15e-2bb88a94c0b2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68312025-02-21T10:07:07.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 647e0159-4bf9-4fe9-ba45-232ea4a00a72 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68322025-02-21T10:07:07.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 647e0159-4bf9-4fe9-ba45-232ea4a00a72 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68332025-02-21T10:07:07.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 647e0159-4bf9-4fe9-ba45-232ea4a00a72 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68342025-02-21T10:07:09.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0bcd8f23-9079-4bc6-8fcd-0ead31db48e3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68352025-02-21T10:07:09.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0bcd8f23-9079-4bc6-8fcd-0ead31db48e3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68362025-02-21T10:07:09.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1863 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0bcd8f23-9079-4bc6-8fcd-0ead31db48e3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68372025-02-21T10:07:10.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3253f227-f410-4695-b614-e39cbc62e5aa roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68382025-02-21T10:07:10.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3253f227-f410-4695-b614-e39cbc62e5aa resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68392025-02-21T10:07:10.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2063 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3253f227-f410-4695-b614-e39cbc62e5aa response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68402025-02-21T10:07:11.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fe0e0ea4-043c-49a3-acfe-96605b8cba8e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68412025-02-21T10:07:11.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fe0e0ea4-043c-49a3-acfe-96605b8cba8e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68422025-02-21T10:07:11.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fe0e0ea4-043c-49a3-acfe-96605b8cba8e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68432025-02-21T10:07:12.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8b8bfc2c-998a-4cec-ac90-1b4ab4eb4954 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68442025-02-21T10:07:12.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8b8bfc2c-998a-4cec-ac90-1b4ab4eb4954 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68452025-02-21T10:07:12.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8b8bfc2c-998a-4cec-ac90-1b4ab4eb4954 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68462025-02-21T10:07:13.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1de388fd-ef9a-475a-91ee-e28b471a07e4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68472025-02-21T10:07:13.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1de388fd-ef9a-475a-91ee-e28b471a07e4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68482025-02-21T10:07:13.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1de388fd-ef9a-475a-91ee-e28b471a07e4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68492025-02-21T10:07:13.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
68502025-02-21T10:07:13.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
68512025-02-21T10:07:13.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68522025-02-21T10:07:13.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68532025-02-21T10:07:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68542025-02-21T10:07:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68552025-02-21T10:07:13.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68562025-02-21T10:07:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68572025-02-21T10:07:13.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68582025-02-21T10:07:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68592025-02-21T10:07:13.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68602025-02-21T10:07:13.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68612025-02-21T10:07:13.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68622025-02-21T10:07:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
68632025-02-21T10:07:13.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68642025-02-21T10:07:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68652025-02-21T10:07:13.581ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
68662025-02-21T10:07:13.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.274371ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
68672025-02-21T10:07:13.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68682025-02-21T10:07:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68692025-02-21T10:07:13.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.190563ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68702025-02-21T10:07:14.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8010ff6b-f4f8-4545-849b-4fd9020c3692 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68712025-02-21T10:07:14.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8010ff6b-f4f8-4545-849b-4fd9020c3692 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68722025-02-21T10:07:14.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8010ff6b-f4f8-4545-849b-4fd9020c3692 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68732025-02-21T10:07:15.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fb8b7b98-5a81-4eab-858e-731c49f49867 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68742025-02-21T10:07:15.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fb8b7b98-5a81-4eab-858e-731c49f49867 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68752025-02-21T10:07:15.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2586 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = fb8b7b98-5a81-4eab-858e-731c49f49867 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68762025-02-21T10:07:16.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5cdefb33-ea46-428c-a8c1-0be1983e9c9b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68772025-02-21T10:07:16.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5cdefb33-ea46-428c-a8c1-0be1983e9c9b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68782025-02-21T10:07:16.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5cdefb33-ea46-428c-a8c1-0be1983e9c9b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68792025-02-21T10:07:16.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 852 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = a49a3b55-9bd0-4108-b89c-687cc4ad199d response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
68802025-02-21T10:07:17.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5b077c4d-706e-4cf8-a926-5af9c82df4b9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68812025-02-21T10:07:17.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5b077c4d-706e-4cf8-a926-5af9c82df4b9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68822025-02-21T10:07:17.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1928 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5b077c4d-706e-4cf8-a926-5af9c82df4b9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68832025-02-21T10:07:18.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6999a4f7-2e15-4c69-8613-1ba689ac1247 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68842025-02-21T10:07:18.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6999a4f7-2e15-4c69-8613-1ba689ac1247 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68852025-02-21T10:07:18.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1598 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6999a4f7-2e15-4c69-8613-1ba689ac1247 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68862025-02-21T10:07:19.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3666f61f-145a-4c0a-bd32-dcf19cfdd57d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68872025-02-21T10:07:19.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3666f61f-145a-4c0a-bd32-dcf19cfdd57d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68882025-02-21T10:07:19.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2695 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3666f61f-145a-4c0a-bd32-dcf19cfdd57d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68892025-02-21T10:07:20.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 59425aa1-876c-4547-9c85-66c8d76b0a63 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68902025-02-21T10:07:20.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 59425aa1-876c-4547-9c85-66c8d76b0a63 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68912025-02-21T10:07:20.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 59425aa1-876c-4547-9c85-66c8d76b0a63 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68922025-02-21T10:07:21.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ae640e85-bf48-4632-b444-9d3d92172193 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68932025-02-21T10:07:21.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ae640e85-bf48-4632-b444-9d3d92172193 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68942025-02-21T10:07:21.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ae640e85-bf48-4632-b444-9d3d92172193 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68952025-02-21T10:07:22.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4ce0feb4-00aa-4086-9781-a63c31bea7b6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68962025-02-21T10:07:22.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4ce0feb4-00aa-4086-9781-a63c31bea7b6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68972025-02-21T10:07:22.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2626 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4ce0feb4-00aa-4086-9781-a63c31bea7b6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
68982025-02-21T10:07:22.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = e21a6e2b-3d39-461f-bb9f-8070fbd1b0b5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
68992025-02-21T10:07:22.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = e21a6e2b-3d39-461f-bb9f-8070fbd1b0b5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
69002025-02-21T10:07:22.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2845 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = e21a6e2b-3d39-461f-bb9f-8070fbd1b0b5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
69012025-02-21T10:07:23.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 07d7af7e-b539-45db-86e6-b7c2d10c997f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
69022025-02-21T10:07:23.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 07d7af7e-b539-45db-86e6-b7c2d10c997f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
69032025-02-21T10:07:23.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2128 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 07d7af7e-b539-45db-86e6-b7c2d10c997f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
69042025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
69052025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
69062025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69072025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69082025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
69092025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
69102025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
69112025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
69122025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
69132025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
69142025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
69152025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69162025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69172025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
69182025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
69192025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69202025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69212025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
69222025-02-21T10:07:23.558ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69232025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
69242025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69252025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
69262025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69272025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
69282025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
69292025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69302025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
69312025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
69322025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69332025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
69342025-02-21T10:07:23.558ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-21 09:57:23.558430890 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
69352025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
69362025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
69372025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69382025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
69392025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
69402025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
69412025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69422025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
69432025-02-21T10:07:23.558ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
69442025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69452025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69462025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
69472025-02-21T10:07:23.558ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041
69482025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.74\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041"}
69492025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
69502025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
69512025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69522025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69532025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
69542025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69552025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
69562025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
69572025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
69582025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
69592025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69602025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
69612025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69622025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
69632025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69642025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
69652025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69662025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
69672025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69682025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
69692025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69702025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
69712025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69722025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
69732025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69742025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69752025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69762025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69772025-02-21T10:07:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69782025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69792025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69802025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69812025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69822025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69832025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69842025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69852025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69862025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69872025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69882025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
69892025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69902025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69912025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69922025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69932025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69942025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69952025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69962025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69972025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69982025-02-21T10:07:23.559ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d154e9e-6d90-4040-b311-004f0e299e85.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e63432d-4205-48df-bd2b-03a054e87ab0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 857264723 } })
69992025-02-21T10:07:23.559ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3bf841e1-42b9-4bd7-ac20-7644b8a83464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 857262503 } })
70002025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70012025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70022025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70032025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70042025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70052025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70062025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
70072025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70082025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70092025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.318652ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
70102025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
70112025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.494816ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
70122025-02-21T10:07:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70132025-02-21T10:07:23.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70142025-02-21T10:07:23.562ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.162371ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70152025-02-21T10:07:23.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70162025-02-21T10:07:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70172025-02-21T10:07:23.564ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70182025-02-21T10:07:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70192025-02-21T10:07:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70202025-02-21T10:07:23.564ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70212025-02-21T10:07:23.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70222025-02-21T10:07:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70232025-02-21T10:07:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70242025-02-21T10:07:23.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70252025-02-21T10:07:23.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70262025-02-21T10:07:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70272025-02-21T10:07:23.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70282025-02-21T10:07:23.568ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70292025-02-21T10:07:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70302025-02-21T10:07:23.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70312025-02-21T10:07:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70322025-02-21T10:07:23.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70332025-02-21T10:07:23.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70342025-02-21T10:07:23.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
70352025-02-21T10:07:23.570ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70362025-02-21T10:07:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70372025-02-21T10:07:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70382025-02-21T10:07:23.573ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.32451ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
70392025-02-21T10:07:23.574ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-21 09:57:23.558430890 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
70402025-02-21T10:07:23.574ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.601526ms iteration = 10 status = {"expiration":"2025-02-21T09:57:23.558430890Z","pruned":[]}
70412025-02-21T10:07:23.577ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 875098873 } })
70422025-02-21T10:07:23.577ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
70432025-02-21T10:07:23.577ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 875742319 } })
70442025-02-21T10:07:23.578ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
70452025-02-21T10:07:23.598ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 40.240451ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
70462025-02-21T10:07:23.599ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70472025-02-21T10:07:23.599ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70482025-02-21T10:07:23.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70492025-02-21T10:07:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70502025-02-21T10:07:23.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70512025-02-21T10:07:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70522025-02-21T10:07:23.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70532025-02-21T10:07:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70542025-02-21T10:07:23.605ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
70552025-02-21T10:07:23.605ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
70562025-02-21T10:07:23.605ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 45.623051ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
70572025-02-21T10:07:23.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70582025-02-21T10:07:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70592025-02-21T10:07:23.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70602025-02-21T10:07:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70612025-02-21T10:07:23.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70622025-02-21T10:07:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70632025-02-21T10:07:23.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70642025-02-21T10:07:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70652025-02-21T10:07:23.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70662025-02-21T10:07:23.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672025-02-21T10:07:23.613ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70682025-02-21T10:07:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70692025-02-21T10:07:23.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70702025-02-21T10:07:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70712025-02-21T10:07:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70722025-02-21T10:07:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70732025-02-21T10:07:23.616ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70742025-02-21T10:07:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70752025-02-21T10:07:23.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70762025-02-21T10:07:23.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70772025-02-21T10:07:23.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70782025-02-21T10:07:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70792025-02-21T10:07:23.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70802025-02-21T10:07:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70812025-02-21T10:07:23.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70822025-02-21T10:07:23.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70832025-02-21T10:07:23.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70842025-02-21T10:07:23.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70852025-02-21T10:07:23.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70862025-02-21T10:07:23.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70872025-02-21T10:07:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70882025-02-21T10:07:23.624ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 922692122 } })
70892025-02-21T10:07:23.624ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
70902025-02-21T10:07:23.625ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70912025-02-21T10:07:23.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70922025-02-21T10:07:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70932025-02-21T10:07:23.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.060976ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
70942025-02-21T10:07:23.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.096762ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70952025-02-21T10:07:23.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70962025-02-21T10:07:23.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70972025-02-21T10:07:23.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70982025-02-21T10:07:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70992025-02-21T10:07:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71002025-02-21T10:07:23.631ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71012025-02-21T10:07:23.631ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71022025-02-21T10:07:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71032025-02-21T10:07:23.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.522884ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
71042025-02-21T10:07:23.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71052025-02-21T10:07:23.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71062025-02-21T10:07:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71072025-02-21T10:07:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71082025-02-21T10:07:23.633ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71092025-02-21T10:07:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71102025-02-21T10:07:23.633ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71112025-02-21T10:07:23.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71122025-02-21T10:07:23.635ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71132025-02-21T10:07:23.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71142025-02-21T10:07:23.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71152025-02-21T10:07:23.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71162025-02-21T10:07:23.636ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71172025-02-21T10:07:23.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71182025-02-21T10:07:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
71192025-02-21T10:07:23.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71202025-02-21T10:07:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71212025-02-21T10:07:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71222025-02-21T10:07:23.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71232025-02-21T10:07:23.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71242025-02-21T10:07:23.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71252025-02-21T10:07:23.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71262025-02-21T10:07:23.642ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 84.137471ms iteration = 5 status = {"nsuccess":5}
71272025-02-21T10:07:23.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71282025-02-21T10:07:23.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71292025-02-21T10:07:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71302025-02-21T10:07:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
71312025-02-21T10:07:23.648ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71322025-02-21T10:07:23.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71332025-02-21T10:07:23.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71342025-02-21T10:07:23.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71352025-02-21T10:07:23.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71362025-02-21T10:07:23.650ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71372025-02-21T10:07:23.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71382025-02-21T10:07:23.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71392025-02-21T10:07:23.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71402025-02-21T10:07:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71412025-02-21T10:07:23.654ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
71422025-02-21T10:07:23.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.782242ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
71432025-02-21T10:07:23.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71442025-02-21T10:07:23.654ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71452025-02-21T10:07:23.654ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71462025-02-21T10:07:23.654ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71472025-02-21T10:07:23.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71482025-02-21T10:07:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71492025-02-21T10:07:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
71502025-02-21T10:07:23.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71512025-02-21T10:07:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71522025-02-21T10:07:23.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71532025-02-21T10:07:23.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71542025-02-21T10:07:23.657ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71552025-02-21T10:07:23.657ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 98.868117ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71562025-02-21T10:07:23.657ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.494171ms iteration = 19 status = 0
71572025-02-21T10:07:23.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71582025-02-21T10:07:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71592025-02-21T10:07:23.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71602025-02-21T10:07:23.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71612025-02-21T10:07:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71622025-02-21T10:07:23.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 101.445749ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71632025-02-21T10:07:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71642025-02-21T10:07:23.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71652025-02-21T10:07:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71662025-02-21T10:07:23.660ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71672025-02-21T10:07:23.660ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71682025-02-21T10:07:23.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71692025-02-21T10:07:23.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71702025-02-21T10:07:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71712025-02-21T10:07:23.661ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71722025-02-21T10:07:23.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71732025-02-21T10:07:23.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71742025-02-21T10:07:23.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71752025-02-21T10:07:23.662ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71762025-02-21T10:07:23.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71772025-02-21T10:07:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71782025-02-21T10:07:23.668ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71792025-02-21T10:07:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
71802025-02-21T10:07:23.670ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71812025-02-21T10:07:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71822025-02-21T10:07:23.676ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
71832025-02-21T10:07:23.676ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
71842025-02-21T10:07:23.676ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.814584ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
71852025-02-21T10:07:23.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.825797ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71862025-02-21T10:07:23.696ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
71872025-02-21T10:07:23.696ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
71882025-02-21T10:07:23.696ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
71892025-02-21T10:07:23.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71902025-02-21T10:07:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71912025-02-21T10:07:23.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71922025-02-21T10:07:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71932025-02-21T10:07:23.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71942025-02-21T10:07:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71952025-02-21T10:07:23.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71962025-02-21T10:07:23.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 145.86752ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71972025-02-21T10:07:23.704ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71982025-02-21T10:07:23.704ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 0 version = 2
71992025-02-21T10:07:23.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72002025-02-21T10:07:23.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72012025-02-21T10:07:23.704ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72022025-02-21T10:07:23.704ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72032025-02-21T10:07:23.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72042025-02-21T10:07:23.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72052025-02-21T10:07:23.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72062025-02-21T10:07:23.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72072025-02-21T10:07:23.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72082025-02-21T10:07:23.709ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
72092025-02-21T10:07:23.709ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
72102025-02-21T10:07:23.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72112025-02-21T10:07:23.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72122025-02-21T10:07:23.709ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72132025-02-21T10:07:23.709ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72142025-02-21T10:07:23.709ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.162828ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72152025-02-21T10:07:23.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72162025-02-21T10:07:23.716ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 1 version = 2
72172025-02-21T10:07:23.716ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
72182025-02-21T10:07:23.716ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-21 09:58:29.727106 UTC dns_group = external generation = 2
72192025-02-21T10:07:23.716ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 158.551067ms iteration = 10 status = {"generation":2}
72202025-02-21T10:07:23.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72212025-02-21T10:07:23.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72222025-02-21T10:07:23.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72232025-02-21T10:07:23.721ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
72242025-02-21T10:07:23.721ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
72252025-02-21T10:07:23.721ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-21 09:58:29.164998 UTC dns_group = internal generation = 1
72262025-02-21T10:07:23.721ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 163.084366ms iteration = 10 status = {"generation":1}
72272025-02-21T10:07:23.722ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
72282025-02-21T10:07:23.722ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 163.833354ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
72292025-02-21T10:07:23.735ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
72302025-02-21T10:07:23.735ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 177.107045ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
72312025-02-21T10:07:23.736ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
72322025-02-21T10:07:23.751ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-21T09:58:18.895783Z, time_modified: 2025-02-21T09:58:18.895783Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }) }
72332025-02-21T10:07:23.751ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 193.009219ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]}},"default_endpoint":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
72342025-02-21T10:07:23.753ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
72352025-02-21T10:07:23.753ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72362025-02-21T10:07:23.753ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "89257cad-ae99-4c3e-8c0f-41f55ef853da", "content-length": "26", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
72372025-02-21T10:07:23.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72382025-02-21T10:07:23.754ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72392025-02-21T10:07:23.760ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 202.013936ms iteration = 21 status = {"physical_disks_added":0}
72402025-02-21T10:07:23.774ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
72412025-02-21T10:07:23.915ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
72422025-02-21T10:07:23.915ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72432025-02-21T10:07:23.915ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8d10b3a-66f6-4678-88a5-c28e26de0a68", "content-length": "26", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
72442025-02-21T10:07:23.915ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72452025-02-21T10:07:23.916ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72462025-02-21T10:07:23.971ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
72472025-02-21T10:07:23.971ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72482025-02-21T10:07:23.972ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "334aa3d1-e728-4f88-94fe-f1b8d6e0aa6f", "content-length": "26", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
72492025-02-21T10:07:23.972ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72502025-02-21T10:07:23.975ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
72512025-02-21T10:07:23.976ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72522025-02-21T10:07:23.976ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72532025-02-21T10:07:23.976ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "78e1f4d7-4b6a-437d-9c27-2868bc8eb27a", "content-length": "372", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
72542025-02-21T10:07:23.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72552025-02-21T10:07:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72562025-02-21T10:07:23.991ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72572025-02-21T10:07:23.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72582025-02-21T10:07:23.992ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fa31cca-020f-4722-bb4b-7cbcfba65067", "content-length": "1", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
72592025-02-21T10:07:23.992ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "373c35dc-ba67-464d-bf8f-f6d6b19ec1ca", "content-length": "691", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
72602025-02-21T10:07:23.992ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
72612025-02-21T10:07:23.992ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
72622025-02-21T10:07:23.992ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
72632025-02-21T10:07:23.993ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72642025-02-21T10:07:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72652025-02-21T10:07:23.994ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 435.464353ms iteration = 19 status = {}
72662025-02-21T10:07:23.995ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 437.135293ms iteration = 19 status = null
72672025-02-21T10:07:24.009ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72682025-02-21T10:07:24.018ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72692025-02-21T10:07:24.018ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72702025-02-21T10:07:24.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cb973919-e4ba-4af8-bcd5-b1d40d15d989", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
72712025-02-21T10:07:24.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72722025-02-21T10:07:24.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72732025-02-21T10:07:24.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72742025-02-21T10:07:24.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72752025-02-21T10:07:24.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72762025-02-21T10:07:24.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72772025-02-21T10:07:24.027ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72782025-02-21T10:07:24.027ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72792025-02-21T10:07:24.027ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9ba58268-e910-4afd-95f0-0146ad57ffdf", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
72802025-02-21T10:07:24.030ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 472.034845ms iteration = 19 status = {}
72812025-02-21T10:07:24.057ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
72822025-02-21T10:07:24.057ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9b4c6002-f588-4b7c-88aa-5a50188a4a11", "date": "Fri, 21 Feb 2025 10:07:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72832025-02-21T10:07:24.057ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72842025-02-21T10:07:24.059ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9fb57d0c-6396-4033-b6e9-60028c5ed3d9", "date": "Fri, 21 Feb 2025 10:07:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72852025-02-21T10:07:24.059ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72862025-02-21T10:07:24.061ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72872025-02-21T10:07:24.061ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 502.709906ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
72882025-02-21T10:07:24.073ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 514.968851ms iteration = 19 status = {}
72892025-02-21T10:07:24.100ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
72902025-02-21T10:07:24.100ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "69141579-6b78-47c9-a3ad-9be8b1ce10d7", "date": "Fri, 21 Feb 2025 10:07:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72912025-02-21T10:07:24.100ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72922025-02-21T10:07:24.102ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "44cd98f9-26b8-4431-bc8e-404815bb4fd0", "date": "Fri, 21 Feb 2025 10:07:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72932025-02-21T10:07:24.102ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72942025-02-21T10:07:24.104ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ba004d44-b63e-4baf-880f-c9240167d9af", "date": "Fri, 21 Feb 2025 10:07:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72952025-02-21T10:07:24.104ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72962025-02-21T10:07:24.106ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
72972025-02-21T10:07:24.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 548.141943ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72982025-02-21T10:07:24.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72992025-02-21T10:07:24.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73002025-02-21T10:07:24.164ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
73012025-02-21T10:07:24.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73022025-02-21T10:07:24.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73032025-02-21T10:07:24.174ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73042025-02-21T10:07:24.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a7eda89-41f8-4afa-a2c1-4f30d84ce82c", "content-length": "134", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
73052025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73062025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
73072025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73082025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73092025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73102025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73112025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73122025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73132025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73142025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73152025-02-21T10:07:24.174ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
73162025-02-21T10:07:24.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73172025-02-21T10:07:24.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73182025-02-21T10:07:24.177ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73192025-02-21T10:07:24.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac5904c8-2961-4e41-903e-402d02a15b36", "content-length": "2", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
73202025-02-21T10:07:24.177ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73212025-02-21T10:07:24.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2db6596d-c874-4195-bbe4-665f370fe96f", "content-length": "52", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
73222025-02-21T10:07:24.177ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
73232025-02-21T10:07:24.177ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73242025-02-21T10:07:24.277ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "37fe8196-1b34-4e23-8436-213ec4c574ab", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
73252025-02-21T10:07:24.277ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
73262025-02-21T10:07:24.277ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73272025-02-21T10:07:24.277ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a7c2f55-66e8-4e23-b563-8d9ad6b6ad7e", "content-length": "682", "date": "Fri, 21 Feb 2025 10:07:23 GMT"} })
73282025-02-21T10:07:24.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73292025-02-21T10:07:24.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73302025-02-21T10:07:24.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73312025-02-21T10:07:24.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73322025-02-21T10:07:24.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73332025-02-21T10:07:24.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73342025-02-21T10:07:24.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73352025-02-21T10:07:24.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73362025-02-21T10:07:24.299ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 741.294875ms iteration = 19 status = {}
73372025-02-21T10:07:24.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 729d6a5c-738d-4cba-8481-481189ef8632 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73382025-02-21T10:07:24.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 729d6a5c-738d-4cba-8481-481189ef8632 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73392025-02-21T10:07:24.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 729d6a5c-738d-4cba-8481-481189ef8632 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73402025-02-21T10:07:25.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 09d09e00-1a05-4b32-b567-cfffd1606bef roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73412025-02-21T10:07:25.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 09d09e00-1a05-4b32-b567-cfffd1606bef resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73422025-02-21T10:07:25.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2218 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 09d09e00-1a05-4b32-b567-cfffd1606bef response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73432025-02-21T10:07:26.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 581b8871-9eba-45c4-9c46-0a7f3547deed roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73442025-02-21T10:07:26.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 581b8871-9eba-45c4-9c46-0a7f3547deed resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73452025-02-21T10:07:26.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 581b8871-9eba-45c4-9c46-0a7f3547deed response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73462025-02-21T10:07:26.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 498 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = a0ab2ef9-557f-463c-8eff-66ca3f72d87b response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
73472025-02-21T10:07:27.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 298a3e9f-9639-4058-9b50-bee150930fb1 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73482025-02-21T10:07:27.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 298a3e9f-9639-4058-9b50-bee150930fb1 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73492025-02-21T10:07:27.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 298a3e9f-9639-4058-9b50-bee150930fb1 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73502025-02-21T10:07:28.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4e6ab8c5-6627-4679-8e90-ba24631edf15 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73512025-02-21T10:07:28.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4e6ab8c5-6627-4679-8e90-ba24631edf15 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73522025-02-21T10:07:28.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2402 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4e6ab8c5-6627-4679-8e90-ba24631edf15 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73532025-02-21T10:07:29.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3d12a4d3-be72-4490-80d3-6da1fa9058fa roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73542025-02-21T10:07:29.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3d12a4d3-be72-4490-80d3-6da1fa9058fa resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73552025-02-21T10:07:29.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3d12a4d3-be72-4490-80d3-6da1fa9058fa response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73562025-02-21T10:07:30.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d79c66cc-8e54-4205-bc84-a12dd0aafe6b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73572025-02-21T10:07:30.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d79c66cc-8e54-4205-bc84-a12dd0aafe6b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73582025-02-21T10:07:30.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d79c66cc-8e54-4205-bc84-a12dd0aafe6b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73592025-02-21T10:07:31.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0de1db9b-b8c0-4081-90d3-a942347258cb roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73602025-02-21T10:07:31.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0de1db9b-b8c0-4081-90d3-a942347258cb resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73612025-02-21T10:07:31.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0de1db9b-b8c0-4081-90d3-a942347258cb response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73622025-02-21T10:07:32.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b7ce362e-7e25-4fba-98a3-6eca1a4fce87 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73632025-02-21T10:07:32.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b7ce362e-7e25-4fba-98a3-6eca1a4fce87 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73642025-02-21T10:07:32.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2770 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b7ce362e-7e25-4fba-98a3-6eca1a4fce87 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73652025-02-21T10:07:33.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
73662025-02-21T10:07:33.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73672025-02-21T10:07:33.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
73682025-02-21T10:07:33.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73692025-02-21T10:07:33.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73702025-02-21T10:07:33.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73712025-02-21T10:07:33.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73722025-02-21T10:07:33.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73732025-02-21T10:07:33.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73742025-02-21T10:07:33.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.695379ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73752025-02-21T10:07:33.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73762025-02-21T10:07:33.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73772025-02-21T10:07:33.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73782025-02-21T10:07:33.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73792025-02-21T10:07:33.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73802025-02-21T10:07:33.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73812025-02-21T10:07:33.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
73822025-02-21T10:07:33.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73832025-02-21T10:07:33.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73842025-02-21T10:07:33.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
73852025-02-21T10:07:33.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.850872ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
73862025-02-21T10:07:33.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 908a7e90-c1c0-46ff-8ca5-a7072a2b38bb roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73872025-02-21T10:07:33.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 908a7e90-c1c0-46ff-8ca5-a7072a2b38bb resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73882025-02-21T10:07:33.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1891 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 908a7e90-c1c0-46ff-8ca5-a7072a2b38bb response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73892025-02-21T10:07:34.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 905ef7b1-a130-4180-b8ca-0ac0bbd7da66 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73902025-02-21T10:07:34.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 905ef7b1-a130-4180-b8ca-0ac0bbd7da66 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73912025-02-21T10:07:34.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 905ef7b1-a130-4180-b8ca-0ac0bbd7da66 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73922025-02-21T10:07:35.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2db76765-f479-44d9-bb71-03962f628839 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73932025-02-21T10:07:35.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2db76765-f479-44d9-bb71-03962f628839 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73942025-02-21T10:07:35.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1805 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2db76765-f479-44d9-bb71-03962f628839 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
73952025-02-21T10:07:36.537ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:39900
73962025-02-21T10:07:36.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = f236b80b-7887-4c5c-a928-9a99df915013 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
73972025-02-21T10:07:36.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = f236b80b-7887-4c5c-a928-9a99df915013 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
73982025-02-21T10:07:36.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2855 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = f236b80b-7887-4c5c-a928-9a99df915013 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
73992025-02-21T10:07:36.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 95c309ec-4f7e-4b26-aa0a-63e21f258ab5 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
74002025-02-21T10:07:36.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 95c309ec-4f7e-4b26-aa0a-63e21f258ab5 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
74012025-02-21T10:07:36.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2570 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 95c309ec-4f7e-4b26-aa0a-63e21f258ab5 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
74022025-02-21T10:07:36.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 458 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 5a977f91-e417-49b7-aa3b-4b58a698bd38 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
74032025-02-21T10:07:36.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7af537c3-87ef-41d7-9170-774b91248aa4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74042025-02-21T10:07:36.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7af537c3-87ef-41d7-9170-774b91248aa4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74052025-02-21T10:07:36.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1684 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7af537c3-87ef-41d7-9170-774b91248aa4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74062025-02-21T10:07:37.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 078099e0-3dc5-4fd5-aeca-dbb4c590990b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74072025-02-21T10:07:37.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 078099e0-3dc5-4fd5-aeca-dbb4c590990b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74082025-02-21T10:07:37.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 078099e0-3dc5-4fd5-aeca-dbb4c590990b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74092025-02-21T10:07:38.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3b3fa3fc-14a3-4529-a03d-31855c9e5dd6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74102025-02-21T10:07:38.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3b3fa3fc-14a3-4529-a03d-31855c9e5dd6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74112025-02-21T10:07:38.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2023 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3b3fa3fc-14a3-4529-a03d-31855c9e5dd6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74122025-02-21T10:07:39.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a0d9a22e-7223-47eb-ba3d-f0a2bf845695 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74132025-02-21T10:07:39.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a0d9a22e-7223-47eb-ba3d-f0a2bf845695 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74142025-02-21T10:07:39.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a0d9a22e-7223-47eb-ba3d-f0a2bf845695 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74152025-02-21T10:07:40.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 28d03a21-3ce5-42ff-b53b-b25209da7611 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74162025-02-21T10:07:40.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 28d03a21-3ce5-42ff-b53b-b25209da7611 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74172025-02-21T10:07:40.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2243 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 28d03a21-3ce5-42ff-b53b-b25209da7611 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74182025-02-21T10:07:41.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9e2ba8e5-8f56-4886-9cda-c06976054e6d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74192025-02-21T10:07:41.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9e2ba8e5-8f56-4886-9cda-c06976054e6d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74202025-02-21T10:07:41.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1707 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9e2ba8e5-8f56-4886-9cda-c06976054e6d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74212025-02-21T10:07:42.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d89c390-5cf8-457e-b83b-06542f61082e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74222025-02-21T10:07:42.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d89c390-5cf8-457e-b83b-06542f61082e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74232025-02-21T10:07:42.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2489 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d89c390-5cf8-457e-b83b-06542f61082e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74242025-02-21T10:07:43.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
74252025-02-21T10:07:43.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
74262025-02-21T10:07:43.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74272025-02-21T10:07:43.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74282025-02-21T10:07:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74292025-02-21T10:07:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74302025-02-21T10:07:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74312025-02-21T10:07:43.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74322025-02-21T10:07:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74332025-02-21T10:07:43.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.222402ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74342025-02-21T10:07:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74352025-02-21T10:07:43.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74362025-02-21T10:07:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74372025-02-21T10:07:43.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74382025-02-21T10:07:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74392025-02-21T10:07:43.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74402025-02-21T10:07:43.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
74412025-02-21T10:07:43.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74422025-02-21T10:07:43.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74432025-02-21T10:07:43.579ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
74442025-02-21T10:07:43.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.822017ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
74452025-02-21T10:07:43.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c7ba4a37-0c33-45d5-bab3-ea2197d2483c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74462025-02-21T10:07:43.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c7ba4a37-0c33-45d5-bab3-ea2197d2483c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74472025-02-21T10:07:43.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c7ba4a37-0c33-45d5-bab3-ea2197d2483c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74482025-02-21T10:07:44.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7e766adb-90a8-4524-83af-931e8f453b62 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74492025-02-21T10:07:44.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7e766adb-90a8-4524-83af-931e8f453b62 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74502025-02-21T10:07:44.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7e766adb-90a8-4524-83af-931e8f453b62 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74512025-02-21T10:07:45.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 90736597-3284-4e88-8f30-fcb26118bcfe roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74522025-02-21T10:07:45.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 90736597-3284-4e88-8f30-fcb26118bcfe resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74532025-02-21T10:07:45.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1689 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 90736597-3284-4e88-8f30-fcb26118bcfe response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74542025-02-21T10:07:46.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 750 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = d02d3a76-0769-4cbc-b84c-3905eff03cc9 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
74552025-02-21T10:07:46.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5a64280d-0685-48e7-ba6f-2ef1204d45fd roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74562025-02-21T10:07:46.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5a64280d-0685-48e7-ba6f-2ef1204d45fd resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74572025-02-21T10:07:46.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5a64280d-0685-48e7-ba6f-2ef1204d45fd response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74582025-02-21T10:07:47.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8dae9110-4f84-401b-9a9f-e7add566f60a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74592025-02-21T10:07:47.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8dae9110-4f84-401b-9a9f-e7add566f60a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74602025-02-21T10:07:47.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8dae9110-4f84-401b-9a9f-e7add566f60a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74612025-02-21T10:07:48.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 635583b2-456c-4bcc-8024-74938e1ed2ce roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74622025-02-21T10:07:48.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 635583b2-456c-4bcc-8024-74938e1ed2ce resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74632025-02-21T10:07:48.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2468 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 635583b2-456c-4bcc-8024-74938e1ed2ce response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74642025-02-21T10:07:49.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3952f7d7-acb5-4264-a92c-a9d565dbe5f8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74652025-02-21T10:07:49.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3952f7d7-acb5-4264-a92c-a9d565dbe5f8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74662025-02-21T10:07:49.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3952f7d7-acb5-4264-a92c-a9d565dbe5f8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74672025-02-21T10:07:51.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 968ab3be-ff18-4b7f-84ce-647035fac26d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74682025-02-21T10:07:51.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 968ab3be-ff18-4b7f-84ce-647035fac26d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74692025-02-21T10:07:51.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1969 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 968ab3be-ff18-4b7f-84ce-647035fac26d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74702025-02-21T10:07:51.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 9263855f-01cc-4acc-a035-a18c8e586a07 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
74712025-02-21T10:07:51.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 9263855f-01cc-4acc-a035-a18c8e586a07 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
74722025-02-21T10:07:51.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 9263855f-01cc-4acc-a035-a18c8e586a07 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
74732025-02-21T10:07:51.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 0a455a48-1694-4321-a708-c3c2b7a595de roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
74742025-02-21T10:07:51.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 0a455a48-1694-4321-a708-c3c2b7a595de resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
74752025-02-21T10:07:51.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 0a455a48-1694-4321-a708-c3c2b7a595de response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
74762025-02-21T10:07:52.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d2e4efa-c662-46a6-bdff-bd7dabf79cf3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74772025-02-21T10:07:52.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d2e4efa-c662-46a6-bdff-bd7dabf79cf3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74782025-02-21T10:07:52.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 2d2e4efa-c662-46a6-bdff-bd7dabf79cf3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74792025-02-21T10:07:52.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 533dfdbf-46c2-434b-8ed7-7ebdff01c17b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
74802025-02-21T10:07:52.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 533dfdbf-46c2-434b-8ed7-7ebdff01c17b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
74812025-02-21T10:07:52.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3803 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 533dfdbf-46c2-434b-8ed7-7ebdff01c17b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
74822025-02-21T10:07:53.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c13bea9d-40a4-444d-88fb-17ad44cfac47 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74832025-02-21T10:07:53.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c13bea9d-40a4-444d-88fb-17ad44cfac47 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74842025-02-21T10:07:53.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1798 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c13bea9d-40a4-444d-88fb-17ad44cfac47 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
74852025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
74862025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74872025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
74882025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
74892025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74902025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74912025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
74922025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74932025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74942025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
74952025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74962025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
74972025-02-21T10:07:53.557ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74982025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74992025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
75002025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
75012025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75022025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
75032025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
75042025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75052025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
75062025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75072025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
75082025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75092025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
75102025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
75112025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75122025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
75132025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
75142025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
75152025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75162025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75172025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
75182025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75192025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75202025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
75212025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75222025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
75232025-02-21T10:07:53.557ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75242025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75252025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75262025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75272025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75282025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75292025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75302025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75312025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75322025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
75332025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75342025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75352025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75362025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75372025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75382025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75392025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75402025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75412025-02-21T10:07:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75422025-02-21T10:07:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75432025-02-21T10:07:53.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75442025-02-21T10:07:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75452025-02-21T10:07:53.561ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.943065ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75462025-02-21T10:07:53.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75472025-02-21T10:07:53.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75482025-02-21T10:07:53.562ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75492025-02-21T10:07:53.562ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75502025-02-21T10:07:53.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75512025-02-21T10:07:53.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75522025-02-21T10:07:53.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75532025-02-21T10:07:53.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.774004ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
75542025-02-21T10:07:53.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75552025-02-21T10:07:53.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75562025-02-21T10:07:53.567ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572025-02-21T10:07:53.567ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75582025-02-21T10:07:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75592025-02-21T10:07:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75602025-02-21T10:07:53.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75612025-02-21T10:07:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75622025-02-21T10:07:53.569ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75632025-02-21T10:07:53.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75642025-02-21T10:07:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75652025-02-21T10:07:53.569ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75662025-02-21T10:07:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75672025-02-21T10:07:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75682025-02-21T10:07:53.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1671, tv_nsec: 871235860 } })
75692025-02-21T10:07:53.573ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
75702025-02-21T10:07:53.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75712025-02-21T10:07:53.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75722025-02-21T10:07:53.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75732025-02-21T10:07:53.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1671, tv_nsec: 873742240 } })
75742025-02-21T10:07:53.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
75752025-02-21T10:07:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75762025-02-21T10:07:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75772025-02-21T10:07:53.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75782025-02-21T10:07:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75792025-02-21T10:07:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75802025-02-21T10:07:53.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75812025-02-21T10:07:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75822025-02-21T10:07:53.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75832025-02-21T10:07:53.580ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1671, tv_nsec: 878427243 } })
75842025-02-21T10:07:53.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
75852025-02-21T10:07:53.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75862025-02-21T10:07:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75872025-02-21T10:07:53.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75882025-02-21T10:07:53.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75892025-02-21T10:07:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75902025-02-21T10:07:53.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75912025-02-21T10:07:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75922025-02-21T10:07:53.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75932025-02-21T10:07:53.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75942025-02-21T10:07:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75952025-02-21T10:07:53.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75962025-02-21T10:07:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75972025-02-21T10:07:53.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
75982025-02-21T10:07:53.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75992025-02-21T10:07:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76002025-02-21T10:07:53.601ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
76012025-02-21T10:07:53.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.135335ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
76022025-02-21T10:07:53.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76032025-02-21T10:07:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76042025-02-21T10:07:53.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.072116ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76052025-02-21T10:07:53.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76062025-02-21T10:07:53.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76072025-02-21T10:07:53.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76082025-02-21T10:07:53.614ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76092025-02-21T10:07:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76102025-02-21T10:07:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
76112025-02-21T10:07:53.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76122025-02-21T10:07:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76132025-02-21T10:07:53.615ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76142025-02-21T10:07:53.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76152025-02-21T10:07:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76162025-02-21T10:07:53.616ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.307071ms iteration = 20 status = 0
76172025-02-21T10:07:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76182025-02-21T10:07:53.617ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76192025-02-21T10:07:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76202025-02-21T10:07:53.623ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76212025-02-21T10:07:53.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.028273ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76222025-02-21T10:07:53.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76232025-02-21T10:07:53.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76242025-02-21T10:07:53.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76252025-02-21T10:07:53.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.916731ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
76262025-02-21T10:07:53.629ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 71.749392ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
76272025-02-21T10:07:53.633ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76282025-02-21T10:07:53.633ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76292025-02-21T10:07:53.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76302025-02-21T10:07:53.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76312025-02-21T10:07:53.641ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76322025-02-21T10:07:53.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.638109ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76332025-02-21T10:07:53.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.486958ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76342025-02-21T10:07:53.659ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76352025-02-21T10:07:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76362025-02-21T10:07:53.661ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76372025-02-21T10:07:53.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.288557ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
76382025-02-21T10:07:53.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76392025-02-21T10:07:53.663ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76402025-02-21T10:07:53.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76412025-02-21T10:07:53.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76422025-02-21T10:07:53.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76432025-02-21T10:07:53.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76442025-02-21T10:07:53.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76452025-02-21T10:07:53.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76462025-02-21T10:07:53.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76472025-02-21T10:07:53.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482025-02-21T10:07:53.671ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76492025-02-21T10:07:53.671ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76502025-02-21T10:07:53.671ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.073634ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76512025-02-21T10:07:53.671ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76522025-02-21T10:07:53.672ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76532025-02-21T10:07:53.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76542025-02-21T10:07:53.686ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
76552025-02-21T10:07:53.686ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76562025-02-21T10:07:53.686ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f3ad092-dfe7-48e1-97f0-73e52c17d12b", "content-length": "26", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
76572025-02-21T10:07:53.686ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76582025-02-21T10:07:53.688ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
76592025-02-21T10:07:53.694ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
76602025-02-21T10:07:53.694ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 136.225808ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
76612025-02-21T10:07:53.696ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.016735ms iteration = 22 status = {"physical_disks_added":0}
76622025-02-21T10:07:53.780ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
76632025-02-21T10:07:53.780ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76642025-02-21T10:07:53.781ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca4f1dc5-65f5-45f4-9f0e-4e3eddc4cc87", "content-length": "26", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
76652025-02-21T10:07:53.781ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76662025-02-21T10:07:53.782ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76672025-02-21T10:07:53.792ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76682025-02-21T10:07:53.792ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76692025-02-21T10:07:53.793ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "34b0fab0-26ad-419b-a7f3-5ef4dd26d19a", "content-length": "372", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
76702025-02-21T10:07:53.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76712025-02-21T10:07:53.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76722025-02-21T10:07:53.798ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
76732025-02-21T10:07:53.798ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76742025-02-21T10:07:53.798ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e6b7cde-811c-4550-89c2-f1385e46fdba", "content-length": "26", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
76752025-02-21T10:07:53.798ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76762025-02-21T10:07:53.800ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76772025-02-21T10:07:53.807ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
76782025-02-21T10:07:53.807ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76792025-02-21T10:07:53.807ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cd54434c-b6b0-4077-8691-21bdcab872f5", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
76802025-02-21T10:07:53.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76812025-02-21T10:07:53.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76822025-02-21T10:07:53.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76832025-02-21T10:07:53.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76842025-02-21T10:07:53.874ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76852025-02-21T10:07:53.874ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a22c134b-6605-47e6-8ffc-bc83d1924ff8", "content-length": "691", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
76862025-02-21T10:07:53.874ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
76872025-02-21T10:07:53.874ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
76882025-02-21T10:07:53.874ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
76892025-02-21T10:07:53.876ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 318.305944ms iteration = 20 status = {}
76902025-02-21T10:07:53.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76912025-02-21T10:07:53.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76922025-02-21T10:07:53.880ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76932025-02-21T10:07:53.880ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76942025-02-21T10:07:53.880ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "80dc44ef-0653-42e5-a58a-0898866e17ac", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
76952025-02-21T10:07:53.882ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 325.145819ms iteration = 20 status = {}
76962025-02-21T10:07:53.921ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 363.963697ms iteration = 20 status = {}
76972025-02-21T10:07:53.980ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76982025-02-21T10:07:53.980ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1feb7ab2-11a7-4654-b54d-047f02ae2174", "content-length": "1", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
76992025-02-21T10:07:53.983ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77002025-02-21T10:07:53.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77012025-02-21T10:07:53.985ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 427.49818ms iteration = 20 status = null
77022025-02-21T10:07:54.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77032025-02-21T10:07:54.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77042025-02-21T10:07:54.019ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
77052025-02-21T10:07:54.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77062025-02-21T10:07:54.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77072025-02-21T10:07:54.029ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77082025-02-21T10:07:54.029ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5118facb-63d3-4535-85a5-f5e9c5595ffb", "content-length": "134", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
77092025-02-21T10:07:54.029ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77102025-02-21T10:07:54.029ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
77112025-02-21T10:07:54.029ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77122025-02-21T10:07:54.029ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77132025-02-21T10:07:54.029ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77142025-02-21T10:07:54.029ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77152025-02-21T10:07:54.029ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77162025-02-21T10:07:54.029ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77172025-02-21T10:07:54.029ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77182025-02-21T10:07:54.029ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77192025-02-21T10:07:54.030ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
77202025-02-21T10:07:54.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77212025-02-21T10:07:54.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77222025-02-21T10:07:54.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77232025-02-21T10:07:54.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "363acc6a-e8aa-4390-8e2e-5eba0464ee6d", "content-length": "2", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
77242025-02-21T10:07:54.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
77252025-02-21T10:07:54.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "84d806d4-61bd-448d-9c46-6f65a1b2f152", "content-length": "52", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
77262025-02-21T10:07:54.031ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
77272025-02-21T10:07:54.031ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
77282025-02-21T10:07:54.131ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2450870f-d66a-4358-be1c-a5e39a4febd2", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
77292025-02-21T10:07:54.131ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
77302025-02-21T10:07:54.131ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
77312025-02-21T10:07:54.134ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2782821a-c1a6-4ed2-9fd6-f84fef65c7ae", "content-length": "682", "date": "Fri, 21 Feb 2025 10:07:53 GMT"} })
77322025-02-21T10:07:54.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77332025-02-21T10:07:54.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77342025-02-21T10:07:54.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77352025-02-21T10:07:54.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77362025-02-21T10:07:54.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77372025-02-21T10:07:54.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77382025-02-21T10:07:54.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77392025-02-21T10:07:54.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77402025-02-21T10:07:54.151ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 594.073711ms iteration = 20 status = {}
77412025-02-21T10:07:54.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e8bc605a-d76b-4a35-ad40-a2f2a7cc90ec roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77422025-02-21T10:07:54.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e8bc605a-d76b-4a35-ad40-a2f2a7cc90ec resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77432025-02-21T10:07:54.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e8bc605a-d76b-4a35-ad40-a2f2a7cc90ec response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77442025-02-21T10:07:55.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4f2cb456-de2e-491a-9f87-3abbaa169979 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77452025-02-21T10:07:55.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4f2cb456-de2e-491a-9f87-3abbaa169979 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77462025-02-21T10:07:55.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4f2cb456-de2e-491a-9f87-3abbaa169979 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77472025-02-21T10:07:56.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 27ae3f15-bfea-4cf8-859c-3beeab9f6497 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77482025-02-21T10:07:56.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 27ae3f15-bfea-4cf8-859c-3beeab9f6497 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77492025-02-21T10:07:56.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1818 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 27ae3f15-bfea-4cf8-859c-3beeab9f6497 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77502025-02-21T10:07:56.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 744 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = c7f39b9b-23b6-4087-b566-042db7d7c985 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
77512025-02-21T10:07:57.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 32601cb6-5ee5-4a94-8d1a-968418c47cc3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77522025-02-21T10:07:57.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 32601cb6-5ee5-4a94-8d1a-968418c47cc3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77532025-02-21T10:07:57.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 32601cb6-5ee5-4a94-8d1a-968418c47cc3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77542025-02-21T10:07:58.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c4be86c2-ca03-4b8b-a1b1-3bc24728a20a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77552025-02-21T10:07:58.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c4be86c2-ca03-4b8b-a1b1-3bc24728a20a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77562025-02-21T10:07:58.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c4be86c2-ca03-4b8b-a1b1-3bc24728a20a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77572025-02-21T10:07:59.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1da88870-3106-4353-9b52-77c474c1ef64 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77582025-02-21T10:07:59.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1da88870-3106-4353-9b52-77c474c1ef64 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77592025-02-21T10:07:59.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1da88870-3106-4353-9b52-77c474c1ef64 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77602025-02-21T10:08:00.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 27687778-2ba0-476a-b318-4300a10d0937 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77612025-02-21T10:08:00.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 27687778-2ba0-476a-b318-4300a10d0937 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77622025-02-21T10:08:00.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2512 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 27687778-2ba0-476a-b318-4300a10d0937 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77632025-02-21T10:08:01.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b10fea49-77be-40f4-9c32-26478a0c58b3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77642025-02-21T10:08:01.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b10fea49-77be-40f4-9c32-26478a0c58b3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77652025-02-21T10:08:01.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1718 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b10fea49-77be-40f4-9c32-26478a0c58b3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77662025-02-21T10:08:02.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 79f1abc8-26f9-484c-b0cf-4aef6d30dca5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77672025-02-21T10:08:02.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 79f1abc8-26f9-484c-b0cf-4aef6d30dca5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77682025-02-21T10:08:02.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2556 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 79f1abc8-26f9-484c-b0cf-4aef6d30dca5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77692025-02-21T10:08:03.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 382c1f84-8e80-4318-aaf4-7aa8907342c2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77702025-02-21T10:08:03.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 382c1f84-8e80-4318-aaf4-7aa8907342c2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77712025-02-21T10:08:03.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 382c1f84-8e80-4318-aaf4-7aa8907342c2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77722025-02-21T10:08:03.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
77732025-02-21T10:08:03.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
77742025-02-21T10:08:03.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77752025-02-21T10:08:03.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77762025-02-21T10:08:03.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77772025-02-21T10:08:03.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77782025-02-21T10:08:03.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77792025-02-21T10:08:03.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77802025-02-21T10:08:03.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77812025-02-21T10:08:03.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77822025-02-21T10:08:03.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77832025-02-21T10:08:03.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77842025-02-21T10:08:03.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.707733ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77852025-02-21T10:08:03.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77862025-02-21T10:08:03.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77872025-02-21T10:08:03.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77882025-02-21T10:08:03.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
77892025-02-21T10:08:03.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77902025-02-21T10:08:03.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77912025-02-21T10:08:03.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
77922025-02-21T10:08:03.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.128865ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
77932025-02-21T10:08:04.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 25a492c9-39f8-48f9-99ec-53373a2f8dfd roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77942025-02-21T10:08:04.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 25a492c9-39f8-48f9-99ec-53373a2f8dfd resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77952025-02-21T10:08:04.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 25a492c9-39f8-48f9-99ec-53373a2f8dfd response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77962025-02-21T10:08:05.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cc63c6a8-6c94-401a-8954-6f5aa8bb56ff roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77972025-02-21T10:08:05.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cc63c6a8-6c94-401a-8954-6f5aa8bb56ff resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77982025-02-21T10:08:05.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1881 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cc63c6a8-6c94-401a-8954-6f5aa8bb56ff response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
77992025-02-21T10:08:06.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4bbccc64-ece2-487f-a3cb-6856f51d8622 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78002025-02-21T10:08:06.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4bbccc64-ece2-487f-a3cb-6856f51d8622 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78012025-02-21T10:08:06.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4bbccc64-ece2-487f-a3cb-6856f51d8622 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78022025-02-21T10:08:06.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = d68531c3-fda0-4e0a-a9eb-907709e253f4 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
78032025-02-21T10:08:06.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = d68531c3-fda0-4e0a-a9eb-907709e253f4 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
78042025-02-21T10:08:06.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3707 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = d68531c3-fda0-4e0a-a9eb-907709e253f4 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
78052025-02-21T10:08:06.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 8d479c74-cb5b-4e6c-8bf7-ef94d7938d52 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
78062025-02-21T10:08:06.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 8d479c74-cb5b-4e6c-8bf7-ef94d7938d52 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
78072025-02-21T10:08:06.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 8d479c74-cb5b-4e6c-8bf7-ef94d7938d52 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
78082025-02-21T10:08:06.542ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 439 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 1926aada-e2c8-4faa-97ce-4f4f2e18b7c9 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
78092025-02-21T10:08:07.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 130bbe4f-4ade-4dc1-90d9-b9384658a7f5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78102025-02-21T10:08:07.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 130bbe4f-4ade-4dc1-90d9-b9384658a7f5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78112025-02-21T10:08:07.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 130bbe4f-4ade-4dc1-90d9-b9384658a7f5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78122025-02-21T10:08:08.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b32f1edf-ca13-41ee-9bed-92fd6f75e4b7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78132025-02-21T10:08:08.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b32f1edf-ca13-41ee-9bed-92fd6f75e4b7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78142025-02-21T10:08:08.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1598 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b32f1edf-ca13-41ee-9bed-92fd6f75e4b7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78152025-02-21T10:08:09.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d467a9c7-5845-43ff-848e-43bfe2b555ce roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78162025-02-21T10:08:09.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d467a9c7-5845-43ff-848e-43bfe2b555ce resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78172025-02-21T10:08:09.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d467a9c7-5845-43ff-848e-43bfe2b555ce response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78182025-02-21T10:08:10.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7ca5aa1a-85ec-47cc-bcf7-bb77f2456287 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78192025-02-21T10:08:10.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7ca5aa1a-85ec-47cc-bcf7-bb77f2456287 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78202025-02-21T10:08:10.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2228 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7ca5aa1a-85ec-47cc-bcf7-bb77f2456287 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78212025-02-21T10:08:11.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d8063c03-c536-47ef-a855-447fe07a3b05 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78222025-02-21T10:08:11.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d8063c03-c536-47ef-a855-447fe07a3b05 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78232025-02-21T10:08:11.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d8063c03-c536-47ef-a855-447fe07a3b05 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78242025-02-21T10:08:12.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f8774b54-15c8-4141-9422-b83ff03b95ab roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78252025-02-21T10:08:12.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f8774b54-15c8-4141-9422-b83ff03b95ab resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78262025-02-21T10:08:12.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f8774b54-15c8-4141-9422-b83ff03b95ab response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78272025-02-21T10:08:13.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
78282025-02-21T10:08:13.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
78292025-02-21T10:08:13.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78302025-02-21T10:08:13.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78312025-02-21T10:08:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78322025-02-21T10:08:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78332025-02-21T10:08:13.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78342025-02-21T10:08:13.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78352025-02-21T10:08:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78362025-02-21T10:08:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78372025-02-21T10:08:13.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78382025-02-21T10:08:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78392025-02-21T10:08:13.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78402025-02-21T10:08:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78412025-02-21T10:08:13.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78422025-02-21T10:08:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
78432025-02-21T10:08:13.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78442025-02-21T10:08:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78452025-02-21T10:08:13.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
78462025-02-21T10:08:13.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.359645ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
78472025-02-21T10:08:13.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.543065ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78482025-02-21T10:08:13.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1296a5c4-16f6-453f-a15c-8054a5a0607c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78492025-02-21T10:08:13.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1296a5c4-16f6-453f-a15c-8054a5a0607c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78502025-02-21T10:08:13.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1973 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1296a5c4-16f6-453f-a15c-8054a5a0607c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78512025-02-21T10:08:14.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3c1ef7bd-11bf-4eae-a7d3-2271d9ec35d6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78522025-02-21T10:08:14.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3c1ef7bd-11bf-4eae-a7d3-2271d9ec35d6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78532025-02-21T10:08:14.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3c1ef7bd-11bf-4eae-a7d3-2271d9ec35d6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78542025-02-21T10:08:15.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 67aede47-4de3-48ed-a932-c48afb1d6e24 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78552025-02-21T10:08:15.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 67aede47-4de3-48ed-a932-c48afb1d6e24 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78562025-02-21T10:08:15.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 67aede47-4de3-48ed-a932-c48afb1d6e24 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78572025-02-21T10:08:16.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 769 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 4273780c-7b0c-412f-a010-dd386bcc039f response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
78582025-02-21T10:08:16.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 90c7472b-70ac-4147-8f13-5cca28113fb9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78592025-02-21T10:08:16.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 90c7472b-70ac-4147-8f13-5cca28113fb9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78602025-02-21T10:08:16.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 90c7472b-70ac-4147-8f13-5cca28113fb9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78612025-02-21T10:08:17.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c5fcfdfe-dd0c-4d3b-9b47-c183fda9b8e5 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78622025-02-21T10:08:17.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c5fcfdfe-dd0c-4d3b-9b47-c183fda9b8e5 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78632025-02-21T10:08:17.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1596 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c5fcfdfe-dd0c-4d3b-9b47-c183fda9b8e5 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78642025-02-21T10:08:18.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ac2e2483-e6d2-4d29-9c9a-55d7e2d51a1f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78652025-02-21T10:08:18.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ac2e2483-e6d2-4d29-9c9a-55d7e2d51a1f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78662025-02-21T10:08:18.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2462 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ac2e2483-e6d2-4d29-9c9a-55d7e2d51a1f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78672025-02-21T10:08:19.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9958a908-4626-41e7-a12e-07610cac6d6a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78682025-02-21T10:08:19.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9958a908-4626-41e7-a12e-07610cac6d6a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78692025-02-21T10:08:19.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9958a908-4626-41e7-a12e-07610cac6d6a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78702025-02-21T10:08:20.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ea48d15a-ff8d-4361-b527-cb08a3b614e2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78712025-02-21T10:08:20.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ea48d15a-ff8d-4361-b527-cb08a3b614e2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78722025-02-21T10:08:20.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ea48d15a-ff8d-4361-b527-cb08a3b614e2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78732025-02-21T10:08:21.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = bb8e4dfb-393f-44a2-aad8-05a50688972b roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
78742025-02-21T10:08:21.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = bb8e4dfb-393f-44a2-aad8-05a50688972b resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
78752025-02-21T10:08:21.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3036 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = bb8e4dfb-393f-44a2-aad8-05a50688972b response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
78762025-02-21T10:08:21.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 2fb33fb4-bd5f-482c-ac6c-9bb15c9d37f3 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
78772025-02-21T10:08:21.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 2fb33fb4-bd5f-482c-ac6c-9bb15c9d37f3 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
78782025-02-21T10:08:21.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2803 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 2fb33fb4-bd5f-482c-ac6c-9bb15c9d37f3 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
78792025-02-21T10:08:21.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bd765cf2-8946-45ce-baa0-ac0fac6cf3d4 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78802025-02-21T10:08:21.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bd765cf2-8946-45ce-baa0-ac0fac6cf3d4 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78812025-02-21T10:08:21.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bd765cf2-8946-45ce-baa0-ac0fac6cf3d4 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78822025-02-21T10:08:22.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 744b3940-1dfc-4b7a-ab31-0933b35731f2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
78832025-02-21T10:08:22.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 744b3940-1dfc-4b7a-ab31-0933b35731f2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
78842025-02-21T10:08:22.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4402 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 744b3940-1dfc-4b7a-ab31-0933b35731f2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
78852025-02-21T10:08:22.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e167dac2-643e-4a58-8e22-f49d14db205d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78862025-02-21T10:08:22.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e167dac2-643e-4a58-8e22-f49d14db205d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78872025-02-21T10:08:22.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e167dac2-643e-4a58-8e22-f49d14db205d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
78882025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
78892025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
78902025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78912025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78922025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
78932025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78942025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
78952025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
78962025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
78972025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
78982025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
78992025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79002025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79012025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
79022025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
79032025-02-21T10:08:23.557ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
79042025-02-21T10:08:23.557ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
79052025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
79062025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
79072025-02-21T10:08:23.557ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041
79082025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.34\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041"}
79092025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
79102025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
79112025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
79122025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
79132025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79142025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
79152025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
79162025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
79172025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79182025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
79192025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
79202025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79212025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
79222025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
79232025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79242025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
79252025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
79262025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
79272025-02-21T10:08:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79282025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
79292025-02-21T10:08:23.558ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
79302025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
79312025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79322025-02-21T10:08:23.558ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-21 09:58:23.557944496 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
79332025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
79342025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
79352025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
79362025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79372025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
79382025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79392025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
79402025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
79412025-02-21T10:08:23.558ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
79422025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
79432025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79442025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79452025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
79462025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79472025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
79482025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79492025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
79502025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79512025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79522025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
79532025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
79542025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
79552025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79562025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
79572025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79582025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79592025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
79602025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
79612025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79622025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
79632025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
79642025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
79652025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
79662025-02-21T10:08:23.558ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
79672025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79682025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79692025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
79702025-02-21T10:08:23.558ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
79712025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79722025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
79732025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
79742025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79752025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
79762025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79772025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
79782025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79792025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79802025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79812025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
79822025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
79832025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79842025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79852025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
79862025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
79872025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79882025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79892025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79902025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79912025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79922025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79932025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79942025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
79952025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79962025-02-21T10:08:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79972025-02-21T10:08:23.558ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d154e9e-6d90-4040-b311-004f0e299e85.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e63432d-4205-48df-bd2b-03a054e87ab0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 857084229 } })
79982025-02-21T10:08:23.558ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3bf841e1-42b9-4bd7-ac20-7644b8a83464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 857102099 } })
79992025-02-21T10:08:23.559ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
80002025-02-21T10:08:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.414944ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
80012025-02-21T10:08:23.559ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
80022025-02-21T10:08:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.338252ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
80032025-02-21T10:08:23.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80042025-02-21T10:08:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80052025-02-21T10:08:23.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80062025-02-21T10:08:23.561ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 859892406 } })
80072025-02-21T10:08:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80082025-02-21T10:08:23.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
80092025-02-21T10:08:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.207102ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80102025-02-21T10:08:23.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80112025-02-21T10:08:23.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80122025-02-21T10:08:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80132025-02-21T10:08:23.564ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
80142025-02-21T10:08:23.564ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
80152025-02-21T10:08:23.564ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.778164ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
80162025-02-21T10:08:23.564ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 6.799084ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
80172025-02-21T10:08:23.564ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80182025-02-21T10:08:23.565ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80192025-02-21T10:08:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80202025-02-21T10:08:23.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80212025-02-21T10:08:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80222025-02-21T10:08:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
80232025-02-21T10:08:23.567ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80242025-02-21T10:08:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80252025-02-21T10:08:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80262025-02-21T10:08:23.568ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80272025-02-21T10:08:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80282025-02-21T10:08:23.569ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80292025-02-21T10:08:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80302025-02-21T10:08:23.569ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80312025-02-21T10:08:23.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80322025-02-21T10:08:23.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80332025-02-21T10:08:23.570ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-21 09:58:23.557944496 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
80342025-02-21T10:08:23.570ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.960482ms iteration = 11 status = {"expiration":"2025-02-21T09:58:23.557944496Z","pruned":[]}
80352025-02-21T10:08:23.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80362025-02-21T10:08:23.572ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
80372025-02-21T10:08:23.572ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
80382025-02-21T10:08:23.572ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.215333ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
80392025-02-21T10:08:23.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
80402025-02-21T10:08:23.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80412025-02-21T10:08:23.573ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80422025-02-21T10:08:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80432025-02-21T10:08:23.573ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80442025-02-21T10:08:23.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80452025-02-21T10:08:23.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80462025-02-21T10:08:23.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80472025-02-21T10:08:23.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80482025-02-21T10:08:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
80492025-02-21T10:08:23.577ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80502025-02-21T10:08:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80512025-02-21T10:08:23.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80522025-02-21T10:08:23.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80532025-02-21T10:08:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80542025-02-21T10:08:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80552025-02-21T10:08:23.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80562025-02-21T10:08:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80572025-02-21T10:08:23.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80582025-02-21T10:08:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80592025-02-21T10:08:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80602025-02-21T10:08:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80612025-02-21T10:08:23.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80622025-02-21T10:08:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80632025-02-21T10:08:23.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80642025-02-21T10:08:23.583ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80652025-02-21T10:08:23.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.653009ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80662025-02-21T10:08:23.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 881913888 } })
80672025-02-21T10:08:23.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
80682025-02-21T10:08:23.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80692025-02-21T10:08:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
80702025-02-21T10:08:23.585ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80712025-02-21T10:08:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80722025-02-21T10:08:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
80732025-02-21T10:08:23.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
80742025-02-21T10:08:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
80752025-02-21T10:08:23.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80762025-02-21T10:08:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80772025-02-21T10:08:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80782025-02-21T10:08:23.589ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
80792025-02-21T10:08:23.589ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
80802025-02-21T10:08:23.589ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
80812025-02-21T10:08:23.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80822025-02-21T10:08:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80832025-02-21T10:08:23.589ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80842025-02-21T10:08:23.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80852025-02-21T10:08:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80862025-02-21T10:08:23.590ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80872025-02-21T10:08:23.590ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(64ffdd8d-b957-4f94-b5f0-50d656bb4127, 0), (881e173d-6f3d-4b65-a99a-deaa479a5801, 0), (6dabbb05-9197-4c70-95a7-43961580e538, 0), (686b0cce-afe0-4ad9-b651-00d312e9ea4e, 0)] collection_id = 64ffdd8d-b957-4f94-b5f0-50d656bb4127
80882025-02-21T10:08:23.590ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80892025-02-21T10:08:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80902025-02-21T10:08:23.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80912025-02-21T10:08:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80922025-02-21T10:08:23.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80932025-02-21T10:08:23.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
80942025-02-21T10:08:23.592ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
80952025-02-21T10:08:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
80962025-02-21T10:08:23.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80972025-02-21T10:08:23.593ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 891529210 } })
80982025-02-21T10:08:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80992025-02-21T10:08:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81002025-02-21T10:08:23.593ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
81012025-02-21T10:08:23.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81022025-02-21T10:08:23.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81032025-02-21T10:08:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81042025-02-21T10:08:23.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81052025-02-21T10:08:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81062025-02-21T10:08:23.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81072025-02-21T10:08:23.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81082025-02-21T10:08:23.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81092025-02-21T10:08:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81102025-02-21T10:08:23.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81112025-02-21T10:08:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81122025-02-21T10:08:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
81132025-02-21T10:08:23.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81142025-02-21T10:08:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81152025-02-21T10:08:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81162025-02-21T10:08:23.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81172025-02-21T10:08:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81182025-02-21T10:08:23.603ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81192025-02-21T10:08:23.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81202025-02-21T10:08:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81212025-02-21T10:08:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
81222025-02-21T10:08:23.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81232025-02-21T10:08:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81242025-02-21T10:08:23.613ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81252025-02-21T10:08:23.613ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81262025-02-21T10:08:23.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81272025-02-21T10:08:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81282025-02-21T10:08:23.614ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81292025-02-21T10:08:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81302025-02-21T10:08:23.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.560569ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
81312025-02-21T10:08:23.616ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81322025-02-21T10:08:23.616ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
81332025-02-21T10:08:23.616ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.092446ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
81342025-02-21T10:08:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81352025-02-21T10:08:23.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.172809ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
81362025-02-21T10:08:23.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.801519ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81372025-02-21T10:08:23.629ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81382025-02-21T10:08:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81392025-02-21T10:08:23.633ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81402025-02-21T10:08:23.633ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.783459ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81412025-02-21T10:08:23.635ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
81422025-02-21T10:08:23.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
81432025-02-21T10:08:23.638ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
81442025-02-21T10:08:23.638ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
81452025-02-21T10:08:23.638ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.435771ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
81462025-02-21T10:08:23.639ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
81472025-02-21T10:08:23.639ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
81482025-02-21T10:08:23.639ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
81492025-02-21T10:08:23.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81502025-02-21T10:08:23.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81512025-02-21T10:08:23.652ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 64ffdd8d-b957-4f94-b5f0-50d656bb4127 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
81522025-02-21T10:08:23.652ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
81532025-02-21T10:08:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81542025-02-21T10:08:23.655ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
81552025-02-21T10:08:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81562025-02-21T10:08:23.658ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
81572025-02-21T10:08:23.667ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
81582025-02-21T10:08:23.667ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
81592025-02-21T10:08:23.667ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81602025-02-21T10:08:23.668ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "982eaa80-43c6-4ccf-ab40-308e319d61e1", "content-length": "26", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
81612025-02-21T10:08:23.668ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81622025-02-21T10:08:23.670ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81632025-02-21T10:08:23.712ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
81642025-02-21T10:08:23.712ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 154.577551ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
81652025-02-21T10:08:23.734ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
81662025-02-21T10:08:23.734ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81672025-02-21T10:08:23.735ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6ac6231-f559-4933-9901-482238295bdf", "content-length": "26", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
81682025-02-21T10:08:23.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81692025-02-21T10:08:23.737ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81702025-02-21T10:08:23.824ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81712025-02-21T10:08:23.825ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "71134d9c-d159-4de3-863b-709eb1a776cc", "content-length": "1", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
81722025-02-21T10:08:23.827ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81732025-02-21T10:08:23.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81742025-02-21T10:08:23.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9dd768ee-7bd7-49e5-ac94-64f856ca0281 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
81752025-02-21T10:08:23.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9dd768ee-7bd7-49e5-ac94-64f856ca0281 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
81762025-02-21T10:08:23.873ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
81772025-02-21T10:08:23.875ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
81782025-02-21T10:08:23.875ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "99ecad4e-6f0e-4626-8bd8-e5d21c1bec87", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81792025-02-21T10:08:23.875ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81802025-02-21T10:08:23.877ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "72790ee9-c35c-4d28-aeeb-a1eae70d8639", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81812025-02-21T10:08:23.877ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81822025-02-21T10:08:23.880ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81832025-02-21T10:08:23.880ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 322.421203ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
81842025-02-21T10:08:23.883ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
81852025-02-21T10:08:23.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
81862025-02-21T10:08:23.909ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
81872025-02-21T10:08:23.909ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81882025-02-21T10:08:23.909ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbe573db-d864-44b2-80ea-bb07628c5836", "content-length": "26", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
81892025-02-21T10:08:23.909ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81902025-02-21T10:08:23.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
81912025-02-21T10:08:23.914ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81922025-02-21T10:08:23.914ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81932025-02-21T10:08:23.914ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 356.125437ms iteration = 21 status = {}
81942025-02-21T10:08:23.914ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8876e39f-1d5c-49e0-b164-74552e93b4a7", "content-length": "372", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
81952025-02-21T10:08:23.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81962025-02-21T10:08:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81972025-02-21T10:08:23.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81982025-02-21T10:08:23.918ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
81992025-02-21T10:08:23.918ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 0 version = 2
82002025-02-21T10:08:23.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82012025-02-21T10:08:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82022025-02-21T10:08:23.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82032025-02-21T10:08:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82042025-02-21T10:08:23.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82052025-02-21T10:08:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82062025-02-21T10:08:23.919ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82072025-02-21T10:08:23.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82082025-02-21T10:08:23.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82092025-02-21T10:08:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82102025-02-21T10:08:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
82112025-02-21T10:08:23.921ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
82122025-02-21T10:08:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
82132025-02-21T10:08:23.924ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 366.939188ms iteration = 21 status = null
82142025-02-21T10:08:23.924ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82152025-02-21T10:08:23.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 81726 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9dd768ee-7bd7-49e5-ac94-64f856ca0281 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
82162025-02-21T10:08:23.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82172025-02-21T10:08:23.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
82182025-02-21T10:08:23.927ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
82192025-02-21T10:08:23.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
82202025-02-21T10:08:23.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82212025-02-21T10:08:23.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82222025-02-21T10:08:23.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82232025-02-21T10:08:23.935ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
82242025-02-21T10:08:23.935ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 377.085822ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
82252025-02-21T10:08:23.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
82262025-02-21T10:08:23.946ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(881e173d-6f3d-4b65-a99a-deaa479a5801, 0), (6dabbb05-9197-4c70-95a7-43961580e538, 0), (686b0cce-afe0-4ad9-b651-00d312e9ea4e, 0), (c993fd81-abec-4c1c-b066-190d7ffb624e, 0)] collection_id = 881e173d-6f3d-4b65-a99a-deaa479a5801
82272025-02-21T10:08:23.947ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82282025-02-21T10:08:23.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82292025-02-21T10:08:23.947ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ea69abd-8959-42f1-a9b4-2df3327c5287", "content-length": "2", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
82302025-02-21T10:08:23.947ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:619 sled = http://[fd00:1122:3344:101::1]:12345
82312025-02-21T10:08:23.949ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 391.104351ms iteration = 3 status = {"last_run_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"operation":"list","target_sled":"9f7d1cf8-48de-4890-ab3d-e135f2248edc","time":"2025-02-21T10:03:23.942948572Z"},{"operation":"list","target_sled":"9f7d1cf8-48de-4890-ab3d-e135f2248edc","time":"2025-02-21T10:08:23.947607242Z"}]}
82322025-02-21T10:08:23.951ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
82332025-02-21T10:08:23.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
82342025-02-21T10:08:23.951ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82352025-02-21T10:08:23.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82362025-02-21T10:08:23.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82372025-02-21T10:08:23.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82382025-02-21T10:08:23.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82392025-02-21T10:08:23.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
82402025-02-21T10:08:23.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
82412025-02-21T10:08:23.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
82422025-02-21T10:08:23.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82432025-02-21T10:08:23.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82442025-02-21T10:08:23.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
82452025-02-21T10:08:23.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
82462025-02-21T10:08:23.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
82472025-02-21T10:08:23.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
82482025-02-21T10:08:23.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82492025-02-21T10:08:23.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82502025-02-21T10:08:23.962ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82512025-02-21T10:08:23.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
82522025-02-21T10:08:23.962ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 404.603767ms iteration = 21 status = 0
82532025-02-21T10:08:23.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82542025-02-21T10:08:23.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
82552025-02-21T10:08:23.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 406.244287ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82562025-02-21T10:08:23.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82572025-02-21T10:08:23.964ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82582025-02-21T10:08:23.964ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82592025-02-21T10:08:23.964ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82602025-02-21T10:08:23.964ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82612025-02-21T10:08:23.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82622025-02-21T10:08:23.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82632025-02-21T10:08:23.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82642025-02-21T10:08:23.966ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
82652025-02-21T10:08:23.966ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "94a7713c-786e-40e0-99bb-d895baea5327", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
82662025-02-21T10:08:23.966ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
82672025-02-21T10:08:23.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82682025-02-21T10:08:23.967ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82692025-02-21T10:08:23.967ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82702025-02-21T10:08:23.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82712025-02-21T10:08:23.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82722025-02-21T10:08:23.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
82732025-02-21T10:08:23.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
82742025-02-21T10:08:23.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
82752025-02-21T10:08:23.968ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "86b6eb35-c898-4b68-a13e-9d7b91d504d2", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
82762025-02-21T10:08:23.968ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
82772025-02-21T10:08:23.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82782025-02-21T10:08:23.970ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a2a5a3f3-6e65-44ca-b76e-151c760a8aee", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
82792025-02-21T10:08:23.970ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
82802025-02-21T10:08:23.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82812025-02-21T10:08:23.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82822025-02-21T10:08:23.972ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
82832025-02-21T10:08:23.972ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 414.785753ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
82842025-02-21T10:08:23.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
82852025-02-21T10:08:23.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
82862025-02-21T10:08:23.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
82872025-02-21T10:08:23.973ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82882025-02-21T10:08:23.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82892025-02-21T10:08:23.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82902025-02-21T10:08:23.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82912025-02-21T10:08:23.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82922025-02-21T10:08:23.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
82932025-02-21T10:08:23.974ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82942025-02-21T10:08:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82952025-02-21T10:08:23.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82962025-02-21T10:08:23.976ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
82972025-02-21T10:08:23.976ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 418.240086ms iteration = 5 status = {"blueprint_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","inventory_collection_id":"c993fd81-abec-4c1c-b066-190d7ffb624e","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
82982025-02-21T10:08:23.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82992025-02-21T10:08:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83002025-02-21T10:08:23.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83012025-02-21T10:08:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83022025-02-21T10:08:23.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83032025-02-21T10:08:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83042025-02-21T10:08:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83052025-02-21T10:08:23.980ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 1 version = 2
83062025-02-21T10:08:23.980ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
83072025-02-21T10:08:23.980ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-21 09:58:29.727106 UTC dns_group = external generation = 2
83082025-02-21T10:08:23.980ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 423.095253ms iteration = 11 status = {"generation":2}
83092025-02-21T10:08:23.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83102025-02-21T10:08:23.983ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
83112025-02-21T10:08:23.983ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83122025-02-21T10:08:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
83132025-02-21T10:08:23.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83142025-02-21T10:08:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83152025-02-21T10:08:23.984ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a174940a-3c02-4fb9-9110-fee6897809f6", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
83162025-02-21T10:08:23.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83172025-02-21T10:08:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83182025-02-21T10:08:23.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83192025-02-21T10:08:23.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83202025-02-21T10:08:23.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83212025-02-21T10:08:23.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83222025-02-21T10:08:23.990ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83232025-02-21T10:08:23.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83242025-02-21T10:08:23.993ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83252025-02-21T10:08:23.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83262025-02-21T10:08:23.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83272025-02-21T10:08:23.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83282025-02-21T10:08:23.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83292025-02-21T10:08:23.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83302025-02-21T10:08:23.997ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83312025-02-21T10:08:23.997ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83322025-02-21T10:08:23.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83332025-02-21T10:08:23.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83342025-02-21T10:08:23.997ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "268819e3-1e0c-4a17-8e91-3016ca286f93", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
83352025-02-21T10:08:23.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83362025-02-21T10:08:23.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83372025-02-21T10:08:23.999ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 441.497347ms iteration = 21 status = {}
83382025-02-21T10:08:24.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83392025-02-21T10:08:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
83402025-02-21T10:08:24.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83412025-02-21T10:08:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83422025-02-21T10:08:24.004ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83432025-02-21T10:08:24.004ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
83442025-02-21T10:08:24.004ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 446.843617ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
83452025-02-21T10:08:24.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83462025-02-21T10:08:24.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83472025-02-21T10:08:24.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83482025-02-21T10:08:24.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83492025-02-21T10:08:24.008ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
83502025-02-21T10:08:24.008ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
83512025-02-21T10:08:24.008ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83522025-02-21T10:08:24.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83532025-02-21T10:08:24.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83542025-02-21T10:08:24.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83552025-02-21T10:08:24.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83562025-02-21T10:08:24.012ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 881e173d-6f3d-4b65-a99a-deaa479a5801 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
83572025-02-21T10:08:24.012ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
83582025-02-21T10:08:24.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83592025-02-21T10:08:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
83602025-02-21T10:08:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83612025-02-21T10:08:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83622025-02-21T10:08:24.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83632025-02-21T10:08:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83642025-02-21T10:08:24.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 457.196057ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
83652025-02-21T10:08:24.015ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83662025-02-21T10:08:24.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83672025-02-21T10:08:24.016ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
83682025-02-21T10:08:24.016ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
83692025-02-21T10:08:24.016ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-21 09:58:29.164998 UTC dns_group = internal generation = 1
83702025-02-21T10:08:24.016ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 458.204852ms iteration = 11 status = {"generation":1}
83712025-02-21T10:08:24.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83722025-02-21T10:08:24.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83732025-02-21T10:08:24.017ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-21T09:58:18.895783Z, time_modified: 2025-02-21T09:58:18.895783Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }) }
83742025-02-21T10:08:24.017ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 459.511762ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]}},"default_endpoint":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
83752025-02-21T10:08:24.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83762025-02-21T10:08:24.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
83772025-02-21T10:08:24.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83782025-02-21T10:08:24.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83792025-02-21T10:08:24.022ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(6dabbb05-9197-4c70-95a7-43961580e538, 0), (686b0cce-afe0-4ad9-b651-00d312e9ea4e, 0), (c993fd81-abec-4c1c-b066-190d7ffb624e, 0)]
83802025-02-21T10:08:24.022ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 321141411 } })
83812025-02-21T10:08:24.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83822025-02-21T10:08:24.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83832025-02-21T10:08:24.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83842025-02-21T10:08:24.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83852025-02-21T10:08:24.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83862025-02-21T10:08:24.028ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
83872025-02-21T10:08:24.028ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cb2dfe9-fc91-4f40-ba2e-59c5fe059258", "content-length": "691", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
83882025-02-21T10:08:24.028ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
83892025-02-21T10:08:24.028ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
83902025-02-21T10:08:24.028ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
83912025-02-21T10:08:24.029ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 471.80412ms iteration = 21 status = {}
83922025-02-21T10:08:24.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
83932025-02-21T10:08:24.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83942025-02-21T10:08:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83952025-02-21T10:08:24.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83962025-02-21T10:08:24.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83972025-02-21T10:08:24.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83982025-02-21T10:08:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83992025-02-21T10:08:24.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84002025-02-21T10:08:24.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84012025-02-21T10:08:24.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84022025-02-21T10:08:24.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84032025-02-21T10:08:24.044ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84042025-02-21T10:08:24.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84052025-02-21T10:08:24.045ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
84062025-02-21T10:08:24.045ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 487.123449ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
84072025-02-21T10:08:24.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84082025-02-21T10:08:24.045ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 487.890188ms iteration = 23 status = {"physical_disks_added":0}
84092025-02-21T10:08:24.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84102025-02-21T10:08:24.047ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84112025-02-21T10:08:24.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84122025-02-21T10:08:24.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84132025-02-21T10:08:24.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
84142025-02-21T10:08:24.052ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84152025-02-21T10:08:24.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84162025-02-21T10:08:24.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84172025-02-21T10:08:24.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84182025-02-21T10:08:24.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84192025-02-21T10:08:24.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84202025-02-21T10:08:24.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84212025-02-21T10:08:24.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
84222025-02-21T10:08:24.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84232025-02-21T10:08:24.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84242025-02-21T10:08:24.065ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 297e1ece-21a5-4e9a-97ed-81e96ccfe78d, kind: Service { id: 0a6b3afe-b742-4846-b618-6c7f1a45f298 }, name: Name("nexus-0a6b3afe-b742-4846-b618-6c7f1a45f298"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e11ed28-c8e5-4904-8d4a-018d5b3b74e6, kind: Service { id: 78cc7a50-acf8-416c-b0e8-3080705dc078 }, name: Name("nexus-78cc7a50-acf8-416c-b0e8-3080705dc078"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 71])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b89732c-7664-4050-9a75-ef3f22ab224c, kind: Service { id: 91873638-4636-473a-93ff-2169ae6acba5 }, name: Name("nexus-91873638-4636-473a-93ff-2169ae6acba5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 219])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 4c4377b4-8dba-407d-9f3b-24ff09cc2957, kind: Service { id: 5eee7a17-bcfb-4922-9f12-263ce2aa9c0f }, name: Name("external-dns-5eee7a17-bcfb-4922-9f12-263ce2aa9c0f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff8ce111-7b5c-4a52-b63c-cc7123970750, kind: Service { id: 3bf841e1-42b9-4bd7-ac20-7644b8a83464 }, name: Name("external-dns-3bf841e1-42b9-4bd7-ac20-7644b8a83464"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
84252025-02-21T10:08:24.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84262025-02-21T10:08:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84272025-02-21T10:08:24.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84282025-02-21T10:08:24.068ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
84292025-02-21T10:08:24.068ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84302025-02-21T10:08:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84312025-02-21T10:08:24.070ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
84322025-02-21T10:08:24.070ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4c4377b4-8dba-407d-9f3b-24ff09cc2957, kind: Service { id: 5eee7a17-bcfb-4922-9f12-263ce2aa9c0f }, name: Name("external-dns-5eee7a17-bcfb-4922-9f12-263ce2aa9c0f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff8ce111-7b5c-4a52-b63c-cc7123970750, kind: Service { id: 3bf841e1-42b9-4bd7-ac20-7644b8a83464 }, name: Name("external-dns-3bf841e1-42b9-4bd7-ac20-7644b8a83464"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 297e1ece-21a5-4e9a-97ed-81e96ccfe78d, kind: Service { id: 0a6b3afe-b742-4846-b618-6c7f1a45f298 }, name: Name("nexus-0a6b3afe-b742-4846-b618-6c7f1a45f298"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e11ed28-c8e5-4904-8d4a-018d5b3b74e6, kind: Service { id: 78cc7a50-acf8-416c-b0e8-3080705dc078 }, name: Name("nexus-78cc7a50-acf8-416c-b0e8-3080705dc078"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 71])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7b89732c-7664-4050-9a75-ef3f22ab224c, kind: Service { id: 91873638-4636-473a-93ff-2169ae6acba5 }, name: Name("nexus-91873638-4636-473a-93ff-2169ae6acba5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 219])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
84332025-02-21T10:08:24.070ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
84342025-02-21T10:08:24.088ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
84352025-02-21T10:08:24.088ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
84362025-02-21T10:08:24.088ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
84372025-02-21T10:08:24.088ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "facb0c26-e2c4-4806-8fc2-d6563bf78b32", "content-length": "476", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84382025-02-21T10:08:24.088ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
84392025-02-21T10:08:24.089ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b079445-32b9-4896-ae36-551440c7fdff", "content-length": "734", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84402025-02-21T10:08:24.089ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
84412025-02-21T10:08:24.089ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c20b30f8-f32f-4d89-a93a-d85f07eda552", "content-length": "111", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84422025-02-21T10:08:24.089ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
84432025-02-21T10:08:24.089ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "551814d4-9b96-4498-89fa-3920d5100ed0", "content-length": "111", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84442025-02-21T10:08:24.089ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
84452025-02-21T10:08:24.089ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5bcc4d2-9a09-4797-81a2-ad776b010593", "content-length": "167", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84462025-02-21T10:08:24.089ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
84472025-02-21T10:08:24.090ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "42a269a1-c0dc-4260-b372-1e2ad4e4059f", "content-length": "167", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84482025-02-21T10:08:24.090ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
84492025-02-21T10:08:24.090ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "86bad10b-cff8-4cfd-a6d1-7e4aef250632", "content-length": "175", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84502025-02-21T10:08:24.090ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
84512025-02-21T10:08:24.090ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5049ee8-2273-461a-8bc4-d52866f47a44", "content-length": "175", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84522025-02-21T10:08:24.090ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
84532025-02-21T10:08:24.090ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbda97c6-8f1a-4806-8f00-3830e5a7d05a", "content-length": "702", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84542025-02-21T10:08:24.090ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
84552025-02-21T10:08:24.090ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fb391bc-9c5f-4b7b-86ed-2d5ae452613a", "content-length": "727", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84562025-02-21T10:08:24.090ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
84572025-02-21T10:08:24.091ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "50245278-1b3d-42d9-bcbd-ef36c4d3b718", "content-length": "729", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84582025-02-21T10:08:24.091ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
84592025-02-21T10:08:24.091ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "168c9e01-d4b1-48a0-bdf3-1c1d04fd5545", "content-length": "728", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84602025-02-21T10:08:24.091ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
84612025-02-21T10:08:24.091ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5159f19a-a3c4-4bb1-9807-173fceac9fe8", "content-length": "722", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84622025-02-21T10:08:24.091ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
84632025-02-21T10:08:24.091ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab6eeb1a-f74d-481e-a040-c11c8474a15d", "content-length": "109", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84642025-02-21T10:08:24.091ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
84652025-02-21T10:08:24.091ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "02b9e4d3-f210-4ec9-b64c-4e47548af442", "content-length": "109", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84662025-02-21T10:08:24.091ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
84672025-02-21T10:08:24.092ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "435c8f8f-f29a-4a5b-9b29-83812386e813", "content-length": "169", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84682025-02-21T10:08:24.092ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
84692025-02-21T10:08:24.092ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "60ec7eba-c21f-43e2-b1ea-9f9bb5d1f363", "content-length": "169", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84702025-02-21T10:08:24.092ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
84712025-02-21T10:08:24.092ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "62f7cdad-1042-4073-8bc9-c9478f18f412", "content-length": "178", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84722025-02-21T10:08:24.092ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
84732025-02-21T10:08:24.092ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "30060a18-10f2-4eab-b111-34854f68c277", "content-length": "178", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84742025-02-21T10:08:24.092ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
84752025-02-21T10:08:24.092ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "54c9deec-00b7-48bf-b94d-7d59085d5c58", "content-length": "702", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84762025-02-21T10:08:24.092ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
84772025-02-21T10:08:24.093ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2a05821-02b2-4f00-8b67-ceeb9438ef91", "content-length": "727", "date": "Fri, 21 Feb 2025 10:08:24 GMT"} })
84782025-02-21T10:08:24.093ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
84792025-02-21T10:08:24.093ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7445ce9b-5071-44c9-8866-c27bc88a8489", "content-length": "729", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84802025-02-21T10:08:24.093ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
84812025-02-21T10:08:24.093ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "77101617-d150-4e2c-876d-7c49d3964ef3", "content-length": "728", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84822025-02-21T10:08:24.093ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84832025-02-21T10:08:24.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84842025-02-21T10:08:24.095ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84852025-02-21T10:08:24.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
84862025-02-21T10:08:24.096ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84872025-02-21T10:08:24.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84882025-02-21T10:08:24.098ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84892025-02-21T10:08:24.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
84902025-02-21T10:08:24.100ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84912025-02-21T10:08:24.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84922025-02-21T10:08:24.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84932025-02-21T10:08:24.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84942025-02-21T10:08:24.106ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
84952025-02-21T10:08:24.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84962025-02-21T10:08:24.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84972025-02-21T10:08:24.116ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84982025-02-21T10:08:24.116ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "36fa7cb3-8818-47c0-95b3-742f3d6fb71a", "content-length": "134", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
84992025-02-21T10:08:24.116ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85002025-02-21T10:08:24.116ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
85012025-02-21T10:08:24.116ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85022025-02-21T10:08:24.116ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85032025-02-21T10:08:24.116ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85042025-02-21T10:08:24.116ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85052025-02-21T10:08:24.116ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85062025-02-21T10:08:24.116ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85072025-02-21T10:08:24.116ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85082025-02-21T10:08:24.116ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85092025-02-21T10:08:24.117ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
85102025-02-21T10:08:24.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85112025-02-21T10:08:24.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85122025-02-21T10:08:24.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85132025-02-21T10:08:24.119ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4122094d-3d3e-4bd4-82e5-0c65c4d9a24c", "content-length": "2", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
85142025-02-21T10:08:24.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85152025-02-21T10:08:24.119ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8307cfd-d699-48a2-8428-a1e07ba94b05", "content-length": "52", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
85162025-02-21T10:08:24.119ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
85172025-02-21T10:08:24.119ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85182025-02-21T10:08:24.128ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, time_created: 2025-02-21T09:58:29.353603Z, time_modified: 2025-02-21T09:58:29.353603Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
85192025-02-21T10:08:24.128ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
85202025-02-21T10:08:24.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85212025-02-21T10:08:24.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85222025-02-21T10:08:24.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85232025-02-21T10:08:24.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85242025-02-21T10:08:24.133ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
85252025-02-21T10:08:24.133ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
85262025-02-21T10:08:24.134ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85272025-02-21T10:08:24.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
85282025-02-21T10:08:24.167ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
85292025-02-21T10:08:24.214ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c28a17fe-8bbd-4519-9faa-fa8ce3e9fbc4", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
85302025-02-21T10:08:24.214ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
85312025-02-21T10:08:24.214ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85322025-02-21T10:08:24.215ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "78914a9d-77e1-4a4f-bd3c-2827a745d132", "content-length": "682", "date": "Fri, 21 Feb 2025 10:08:24 GMT"} })
85332025-02-21T10:08:24.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85342025-02-21T10:08:24.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85352025-02-21T10:08:24.215ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "dd0a863d-b5a1-4ed8-be01-a22d9318b3d9", "date": "Fri, 21 Feb 2025 10:08:24 GMT"} })
85362025-02-21T10:08:24.217ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
85372025-02-21T10:08:24.217ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 659.254635ms
85382025-02-21T10:08:24.217ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 659.262595ms iteration = 3 status = {}
85392025-02-21T10:08:24.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85402025-02-21T10:08:24.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85412025-02-21T10:08:24.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85422025-02-21T10:08:24.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85432025-02-21T10:08:24.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85442025-02-21T10:08:24.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85452025-02-21T10:08:24.233ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 675.553358ms iteration = 21 status = {}
85462025-02-21T10:08:24.434ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a0fc839-09e7-4e2d-9d41-1738a392e968", "content-length": "31969", "date": "Fri, 21 Feb 2025 10:08:23 GMT"} })
85472025-02-21T10:08:24.436ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
85482025-02-21T10:08:24.436ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
85492025-02-21T10:08:24.436ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
85502025-02-21T10:08:24.438ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
85512025-02-21T10:08:24.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
85522025-02-21T10:08:24.440ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85532025-02-21T10:08:24.441ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
85542025-02-21T10:08:24.442ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
85552025-02-21T10:08:24.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
85562025-02-21T10:08:24.609ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 9f875301-2c8d-4948-9838-c0ca0428f707 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
85572025-02-21T10:08:24.609ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 9f875301-2c8d-4948-9838-c0ca0428f707 time_started = 2025-02-21 10:08:24.088456 UTC
85582025-02-21T10:08:24.609ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.052136869s iteration = 3 status = {"collection_id":"9f875301-2c8d-4948-9838-c0ca0428f707","time_done":"2025-02-21 10:08:24.436481 UTC","time_started":"2025-02-21 10:08:24.088456 UTC"}
85592025-02-21T10:08:24.609ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
85602025-02-21T10:08:24.609ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
85612025-02-21T10:08:24.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85622025-02-21T10:08:24.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85632025-02-21T10:08:24.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85642025-02-21T10:08:24.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85652025-02-21T10:08:24.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85662025-02-21T10:08:24.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85672025-02-21T10:08:24.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85682025-02-21T10:08:24.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85692025-02-21T10:08:24.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85702025-02-21T10:08:24.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
85712025-02-21T10:08:24.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85722025-02-21T10:08:24.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85732025-02-21T10:08:24.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85742025-02-21T10:08:24.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85752025-02-21T10:08:24.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85762025-02-21T10:08:24.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85772025-02-21T10:08:24.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85782025-02-21T10:08:24.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85792025-02-21T10:08:24.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85802025-02-21T10:08:24.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85812025-02-21T10:08:24.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85822025-02-21T10:08:24.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85832025-02-21T10:08:24.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85842025-02-21T10:08:24.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
85852025-02-21T10:08:24.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85862025-02-21T10:08:24.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85872025-02-21T10:08:24.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85882025-02-21T10:08:24.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
85892025-02-21T10:08:24.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85902025-02-21T10:08:24.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85912025-02-21T10:08:24.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85922025-02-21T10:08:24.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85932025-02-21T10:08:24.656ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 46.115504ms iteration = 24 status = {"physical_disks_added":0}
85942025-02-21T10:08:24.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85952025-02-21T10:08:24.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
85962025-02-21T10:08:24.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
85972025-02-21T10:08:24.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
85982025-02-21T10:08:24.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85992025-02-21T10:08:24.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
86002025-02-21T10:08:24.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
86012025-02-21T10:08:24.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
86022025-02-21T10:08:24.663ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
86032025-02-21T10:08:24.663ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 53.162983ms iteration = 6 status = {"blueprint_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","inventory_collection_id":"9f875301-2c8d-4948-9838-c0ca0428f707","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
86042025-02-21T10:08:24.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f0c4ce9e-6c88-41c2-a621-811a98ff2299 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86052025-02-21T10:08:24.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f0c4ce9e-6c88-41c2-a621-811a98ff2299 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86062025-02-21T10:08:24.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2000 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f0c4ce9e-6c88-41c2-a621-811a98ff2299 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86072025-02-21T10:08:25.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 67cafcf3-b3c2-4382-897e-098764f9ab46 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86082025-02-21T10:08:25.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 67cafcf3-b3c2-4382-897e-098764f9ab46 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86092025-02-21T10:08:25.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2651 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 67cafcf3-b3c2-4382-897e-098764f9ab46 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86102025-02-21T10:08:26.542ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 469 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = be32f143-5233-43da-8938-7fccde437c6f response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
86112025-02-21T10:08:27.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b9ec9de1-47a7-40c2-b179-000f426dae94 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86122025-02-21T10:08:27.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b9ec9de1-47a7-40c2-b179-000f426dae94 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86132025-02-21T10:08:27.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b9ec9de1-47a7-40c2-b179-000f426dae94 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86142025-02-21T10:08:28.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 66a68a39-9b20-409d-9f89-090ea8635855 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86152025-02-21T10:08:28.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 66a68a39-9b20-409d-9f89-090ea8635855 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86162025-02-21T10:08:28.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3321 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 66a68a39-9b20-409d-9f89-090ea8635855 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86172025-02-21T10:08:29.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9390bae7-75a0-48c4-ac3a-7e015952d421 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86182025-02-21T10:08:29.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9390bae7-75a0-48c4-ac3a-7e015952d421 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86192025-02-21T10:08:29.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1915 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9390bae7-75a0-48c4-ac3a-7e015952d421 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86202025-02-21T10:08:30.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6a89dc82-a6cd-4e38-ad9b-73407b7fce5e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86212025-02-21T10:08:30.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6a89dc82-a6cd-4e38-ad9b-73407b7fce5e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86222025-02-21T10:08:30.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2093 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 6a89dc82-a6cd-4e38-ad9b-73407b7fce5e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86232025-02-21T10:08:31.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e8815929-ac2a-4f85-83ad-f9d89c2a751c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86242025-02-21T10:08:31.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e8815929-ac2a-4f85-83ad-f9d89c2a751c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86252025-02-21T10:08:31.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e8815929-ac2a-4f85-83ad-f9d89c2a751c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86262025-02-21T10:08:32.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a2e9f816-5ca6-4c37-87e4-6d553ef71818 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86272025-02-21T10:08:32.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a2e9f816-5ca6-4c37-87e4-6d553ef71818 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86282025-02-21T10:08:32.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a2e9f816-5ca6-4c37-87e4-6d553ef71818 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86292025-02-21T10:08:33.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 898f8a3c-219c-4bc5-8f47-5d3e2cdb71ea roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86302025-02-21T10:08:33.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 898f8a3c-219c-4bc5-8f47-5d3e2cdb71ea resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86312025-02-21T10:08:33.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 898f8a3c-219c-4bc5-8f47-5d3e2cdb71ea response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86322025-02-21T10:08:33.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
86332025-02-21T10:08:33.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86342025-02-21T10:08:33.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
86352025-02-21T10:08:33.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86362025-02-21T10:08:33.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86372025-02-21T10:08:33.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86382025-02-21T10:08:33.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86392025-02-21T10:08:33.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86402025-02-21T10:08:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86412025-02-21T10:08:33.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.230762ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86422025-02-21T10:08:33.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86432025-02-21T10:08:33.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86442025-02-21T10:08:33.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86452025-02-21T10:08:33.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86462025-02-21T10:08:33.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86472025-02-21T10:08:33.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86482025-02-21T10:08:33.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
86492025-02-21T10:08:33.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86502025-02-21T10:08:33.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86512025-02-21T10:08:33.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
86522025-02-21T10:08:33.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.056948ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
86532025-02-21T10:08:34.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1d85d93f-e0bc-4e95-9793-cfb167e9acc9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86542025-02-21T10:08:34.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1d85d93f-e0bc-4e95-9793-cfb167e9acc9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86552025-02-21T10:08:34.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1791 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1d85d93f-e0bc-4e95-9793-cfb167e9acc9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86562025-02-21T10:08:35.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a6c9dfc8-aa2f-42f3-8c1b-c4247cdc5c32 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86572025-02-21T10:08:35.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a6c9dfc8-aa2f-42f3-8c1b-c4247cdc5c32 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86582025-02-21T10:08:35.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a6c9dfc8-aa2f-42f3-8c1b-c4247cdc5c32 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86592025-02-21T10:08:36.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 978ee0f3-50a9-44b7-8e5f-887a09f9c88b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86602025-02-21T10:08:36.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 978ee0f3-50a9-44b7-8e5f-887a09f9c88b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86612025-02-21T10:08:36.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 978ee0f3-50a9-44b7-8e5f-887a09f9c88b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86622025-02-21T10:08:36.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 09622bcd-6bd9-4795-8a7c-cc8f10613e5d roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
86632025-02-21T10:08:36.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 09622bcd-6bd9-4795-8a7c-cc8f10613e5d resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
86642025-02-21T10:08:36.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2816 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 09622bcd-6bd9-4795-8a7c-cc8f10613e5d response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
86652025-02-21T10:08:36.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 70ea8227-00cb-498d-acdd-bf710186e54b roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
86662025-02-21T10:08:36.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 70ea8227-00cb-498d-acdd-bf710186e54b resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
86672025-02-21T10:08:36.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2354 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 70ea8227-00cb-498d-acdd-bf710186e54b response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
86682025-02-21T10:08:36.542ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 446 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 8f724fca-753c-4102-8abb-d3004f031b50 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
86692025-02-21T10:08:37.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bf96e955-d4bc-420d-8808-2732e25904e2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86702025-02-21T10:08:37.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bf96e955-d4bc-420d-8808-2732e25904e2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86712025-02-21T10:08:37.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3032 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bf96e955-d4bc-420d-8808-2732e25904e2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86722025-02-21T10:08:38.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d754ed2a-d50a-4bc4-b01f-6a4e06fd4872 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86732025-02-21T10:08:38.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d754ed2a-d50a-4bc4-b01f-6a4e06fd4872 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86742025-02-21T10:08:38.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d754ed2a-d50a-4bc4-b01f-6a4e06fd4872 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86752025-02-21T10:08:39.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c785dbe6-6b04-4dd2-be9e-31a2b616f22e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86762025-02-21T10:08:39.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c785dbe6-6b04-4dd2-be9e-31a2b616f22e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86772025-02-21T10:08:39.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1740 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c785dbe6-6b04-4dd2-be9e-31a2b616f22e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86782025-02-21T10:08:40.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dfc69d43-9b78-41e2-b8f3-129d1d52762d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86792025-02-21T10:08:40.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dfc69d43-9b78-41e2-b8f3-129d1d52762d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86802025-02-21T10:08:40.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = dfc69d43-9b78-41e2-b8f3-129d1d52762d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86812025-02-21T10:08:41.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b579617f-b039-4d3e-8e4f-c1b490901c8c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86822025-02-21T10:08:41.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b579617f-b039-4d3e-8e4f-c1b490901c8c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86832025-02-21T10:08:41.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1764 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b579617f-b039-4d3e-8e4f-c1b490901c8c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86842025-02-21T10:08:42.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9c273dfd-673c-4d87-85a7-6c5e4de4cf74 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86852025-02-21T10:08:42.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9c273dfd-673c-4d87-85a7-6c5e4de4cf74 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86862025-02-21T10:08:42.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9c273dfd-673c-4d87-85a7-6c5e4de4cf74 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86872025-02-21T10:08:43.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5e09aa77-ab2f-4508-8b79-369ef2a57571 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86882025-02-21T10:08:43.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5e09aa77-ab2f-4508-8b79-369ef2a57571 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86892025-02-21T10:08:43.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5e09aa77-ab2f-4508-8b79-369ef2a57571 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
86902025-02-21T10:08:43.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
86912025-02-21T10:08:43.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
86922025-02-21T10:08:43.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86932025-02-21T10:08:43.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86942025-02-21T10:08:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86952025-02-21T10:08:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86962025-02-21T10:08:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86972025-02-21T10:08:43.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86982025-02-21T10:08:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86992025-02-21T10:08:43.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.103439ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87002025-02-21T10:08:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87012025-02-21T10:08:43.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87022025-02-21T10:08:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87032025-02-21T10:08:43.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87042025-02-21T10:08:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87052025-02-21T10:08:43.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87062025-02-21T10:08:43.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
87072025-02-21T10:08:43.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87082025-02-21T10:08:43.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87092025-02-21T10:08:43.579ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
87102025-02-21T10:08:43.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.215202ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
87112025-02-21T10:08:44.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f00c1998-256a-48ca-bbe8-c949c5fd64cb roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87122025-02-21T10:08:44.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f00c1998-256a-48ca-bbe8-c949c5fd64cb resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87132025-02-21T10:08:44.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f00c1998-256a-48ca-bbe8-c949c5fd64cb response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87142025-02-21T10:08:45.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 73b4b3e3-eaab-4ece-bb75-475809023a20 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87152025-02-21T10:08:45.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 73b4b3e3-eaab-4ece-bb75-475809023a20 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87162025-02-21T10:08:45.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1655 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 73b4b3e3-eaab-4ece-bb75-475809023a20 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87172025-02-21T10:08:46.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7ca3f0e-010a-4ee5-93e6-95b06b36b9fa roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87182025-02-21T10:08:46.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7ca3f0e-010a-4ee5-93e6-95b06b36b9fa resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87192025-02-21T10:08:46.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a7ca3f0e-010a-4ee5-93e6-95b06b36b9fa response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87202025-02-21T10:08:46.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 9a25d7d7-dd9d-4eab-832b-d0f18b2e7327 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
87212025-02-21T10:08:46.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 9a25d7d7-dd9d-4eab-832b-d0f18b2e7327 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
87222025-02-21T10:08:46.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6844 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 9a25d7d7-dd9d-4eab-832b-d0f18b2e7327 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
87232025-02-21T10:08:46.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 0988c3c4-3741-447c-85df-86d79a398d20 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
87242025-02-21T10:08:46.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 0988c3c4-3741-447c-85df-86d79a398d20 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
87252025-02-21T10:08:46.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4447 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 0988c3c4-3741-447c-85df-86d79a398d20 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
87262025-02-21T10:08:46.542ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 481 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 3349a370-9bef-4708-a091-afcae7e729ca response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
87272025-02-21T10:08:47.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 301fbc30-552f-4c19-ba4a-6332b33ea5d7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87282025-02-21T10:08:47.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 301fbc30-552f-4c19-ba4a-6332b33ea5d7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87292025-02-21T10:08:47.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 301fbc30-552f-4c19-ba4a-6332b33ea5d7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87302025-02-21T10:08:48.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cec4faa0-97cd-4f40-97b1-543fe4e969c1 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87312025-02-21T10:08:48.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cec4faa0-97cd-4f40-97b1-543fe4e969c1 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87322025-02-21T10:08:48.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cec4faa0-97cd-4f40-97b1-543fe4e969c1 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87332025-02-21T10:08:49.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e49c1978-0038-4505-ae5a-24b5a8896075 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87342025-02-21T10:08:49.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e49c1978-0038-4505-ae5a-24b5a8896075 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87352025-02-21T10:08:49.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2535 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e49c1978-0038-4505-ae5a-24b5a8896075 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87362025-02-21T10:08:50.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e13c0cf4-59df-45a6-a1d4-7b0d57a312c9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87372025-02-21T10:08:50.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e13c0cf4-59df-45a6-a1d4-7b0d57a312c9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87382025-02-21T10:08:50.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2615 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e13c0cf4-59df-45a6-a1d4-7b0d57a312c9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87392025-02-21T10:08:51.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a08259d4-698e-48c1-bccc-7409b1854616 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87402025-02-21T10:08:51.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a08259d4-698e-48c1-bccc-7409b1854616 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87412025-02-21T10:08:51.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a08259d4-698e-48c1-bccc-7409b1854616 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87422025-02-21T10:08:52.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9dd7d615-7d2d-4385-9ff9-60cb06bac459 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87432025-02-21T10:08:52.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9dd7d615-7d2d-4385-9ff9-60cb06bac459 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87442025-02-21T10:08:52.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2110 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9dd7d615-7d2d-4385-9ff9-60cb06bac459 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
87452025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
87462025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87472025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
87482025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87492025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
87502025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
87512025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87522025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
87532025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87542025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87552025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
87562025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
87572025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87582025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
87592025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
87602025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87612025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
87622025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87632025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
87642025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87652025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
87662025-02-21T10:08:53.557ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87672025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
87682025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87692025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87702025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
87712025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87722025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
87732025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87742025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87752025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
87762025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87772025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
87782025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87792025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
87802025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
87812025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87822025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
87832025-02-21T10:08:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87842025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87852025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87862025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87872025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
87882025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87892025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87902025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87912025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87922025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87932025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87942025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87952025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87962025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87972025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87982025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
87992025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88002025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88012025-02-21T10:08:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88022025-02-21T10:08:53.561ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.866223ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88032025-02-21T10:08:53.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88042025-02-21T10:08:53.564ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88052025-02-21T10:08:53.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88062025-02-21T10:08:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88072025-02-21T10:08:53.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88082025-02-21T10:08:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88092025-02-21T10:08:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88102025-02-21T10:08:53.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88112025-02-21T10:08:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88122025-02-21T10:08:53.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88132025-02-21T10:08:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88142025-02-21T10:08:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88152025-02-21T10:08:53.569ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88162025-02-21T10:08:53.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88172025-02-21T10:08:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88182025-02-21T10:08:53.571ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88192025-02-21T10:08:53.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88202025-02-21T10:08:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88212025-02-21T10:08:53.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88222025-02-21T10:08:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88232025-02-21T10:08:53.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1731, tv_nsec: 872984992 } })
88242025-02-21T10:08:53.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
88252025-02-21T10:08:53.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1731, tv_nsec: 873422873 } })
88262025-02-21T10:08:53.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
88272025-02-21T10:08:53.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88282025-02-21T10:08:53.576ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88292025-02-21T10:08:53.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88302025-02-21T10:08:53.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88312025-02-21T10:08:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88322025-02-21T10:08:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
88332025-02-21T10:08:53.578ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88342025-02-21T10:08:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88352025-02-21T10:08:53.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88362025-02-21T10:08:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88372025-02-21T10:08:53.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88382025-02-21T10:08:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88392025-02-21T10:08:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88402025-02-21T10:08:53.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88412025-02-21T10:08:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88422025-02-21T10:08:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88432025-02-21T10:08:53.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1731, tv_nsec: 882053841 } })
88442025-02-21T10:08:53.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
88452025-02-21T10:08:53.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88462025-02-21T10:08:53.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88472025-02-21T10:08:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88482025-02-21T10:08:53.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88492025-02-21T10:08:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88502025-02-21T10:08:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
88512025-02-21T10:08:53.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88522025-02-21T10:08:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88532025-02-21T10:08:53.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88542025-02-21T10:08:53.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88552025-02-21T10:08:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88562025-02-21T10:08:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88572025-02-21T10:08:53.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88582025-02-21T10:08:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88592025-02-21T10:08:53.605ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
88602025-02-21T10:08:53.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.004768ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
88612025-02-21T10:08:53.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 49.073314ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
88622025-02-21T10:08:53.606ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 49.125466ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
88632025-02-21T10:08:53.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88642025-02-21T10:08:53.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88652025-02-21T10:08:53.612ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88662025-02-21T10:08:53.612ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88672025-02-21T10:08:53.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88682025-02-21T10:08:53.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88692025-02-21T10:08:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88702025-02-21T10:08:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88712025-02-21T10:08:53.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.114674ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
88722025-02-21T10:08:53.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88732025-02-21T10:08:53.616ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88742025-02-21T10:08:53.616ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88752025-02-21T10:08:53.616ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88762025-02-21T10:08:53.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88772025-02-21T10:08:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
88782025-02-21T10:08:53.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88792025-02-21T10:08:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88802025-02-21T10:08:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88812025-02-21T10:08:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88822025-02-21T10:08:53.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88832025-02-21T10:08:53.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.051123ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88842025-02-21T10:08:53.619ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.647767ms iteration = 22 status = 0
88852025-02-21T10:08:53.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88862025-02-21T10:08:53.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88872025-02-21T10:08:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88882025-02-21T10:08:53.620ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88892025-02-21T10:08:53.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88902025-02-21T10:08:53.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88912025-02-21T10:08:53.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88922025-02-21T10:08:53.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.414859ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
88932025-02-21T10:08:53.626ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88942025-02-21T10:08:53.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
88952025-02-21T10:08:53.629ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88962025-02-21T10:08:53.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88972025-02-21T10:08:53.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.946451ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88982025-02-21T10:08:53.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.312564ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88992025-02-21T10:08:53.651ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89002025-02-21T10:08:53.651ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89012025-02-21T10:08:53.651ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 93.332133ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89022025-02-21T10:08:53.660ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
89032025-02-21T10:08:53.660ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 103.155579ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
89042025-02-21T10:08:53.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d05ab34b-0dcc-41ac-af5f-e46d1128505f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
89052025-02-21T10:08:53.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d05ab34b-0dcc-41ac-af5f-e46d1128505f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
89062025-02-21T10:08:53.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2035 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d05ab34b-0dcc-41ac-af5f-e46d1128505f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
89072025-02-21T10:08:53.690ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
89082025-02-21T10:08:53.690ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89092025-02-21T10:08:53.691ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21d9da0c-d2ea-4452-b732-3f8a3a31a323", "content-length": "26", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89102025-02-21T10:08:53.691ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89112025-02-21T10:08:53.692ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
89122025-02-21T10:08:53.693ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
89132025-02-21T10:08:53.693ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89142025-02-21T10:08:53.693ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9648d0f-2797-4002-be14-3b4d43e5226f", "content-length": "26", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89152025-02-21T10:08:53.693ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89162025-02-21T10:08:53.695ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89172025-02-21T10:08:53.706ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.935045ms iteration = 25 status = {"physical_disks_added":0}
89182025-02-21T10:08:53.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89192025-02-21T10:08:53.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89202025-02-21T10:08:53.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89212025-02-21T10:08:53.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89222025-02-21T10:08:53.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89232025-02-21T10:08:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89242025-02-21T10:08:53.727ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89252025-02-21T10:08:53.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89262025-02-21T10:08:53.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89272025-02-21T10:08:53.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89282025-02-21T10:08:53.744ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
89292025-02-21T10:08:53.744ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89302025-02-21T10:08:53.744ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80e676bb-e31b-43d1-8f55-57bba639631f", "content-length": "26", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89312025-02-21T10:08:53.744ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89322025-02-21T10:08:53.747ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89332025-02-21T10:08:53.822ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89342025-02-21T10:08:53.822ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89352025-02-21T10:08:53.823ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cf87344-6c14-4ec0-aa1b-86359232c1e0", "content-length": "583", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89362025-02-21T10:08:53.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89372025-02-21T10:08:53.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89382025-02-21T10:08:53.838ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {3560d853-4f15-4738-ae4a-6467f41aaa58: {10.151.2.175: {3e9207b2-fd92-46ae-8738-bff18392ab32}, 10.151.2.176: {3e9207b2-fd92-46ae-8738-bff18392ab32}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
89392025-02-21T10:08:53.838ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89402025-02-21T10:08:53.838ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "922a9ef5-eaa2-4deb-a0a3-c42e9e0fa1d6", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89412025-02-21T10:08:53.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89422025-02-21T10:08:53.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89432025-02-21T10:08:53.841ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89442025-02-21T10:08:53.841ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c101d37d-71af-4a06-a744-045406a14992", "content-length": "1", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89452025-02-21T10:08:53.842ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89462025-02-21T10:08:53.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89472025-02-21T10:08:53.846ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/9461702b-804b-4ffb-8c5d-095105df14b3/state
89482025-02-21T10:08:53.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89492025-02-21T10:08:53.849ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 291.552248ms iteration = 22 status = null
89502025-02-21T10:08:53.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89512025-02-21T10:08:53.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89522025-02-21T10:08:53.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89532025-02-21T10:08:53.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89542025-02-21T10:08:53.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89552025-02-21T10:08:53.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89562025-02-21T10:08:53.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89572025-02-21T10:08:53.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89582025-02-21T10:08:53.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89592025-02-21T10:08:53.863ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89602025-02-21T10:08:53.863ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89612025-02-21T10:08:53.863ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89622025-02-21T10:08:53.864ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6ca4cb7c-3172-4d27-a27c-feca2eec9bda", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89632025-02-21T10:08:53.866ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 308.762834ms iteration = 22 status = {}
89642025-02-21T10:08:53.882ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 325.316223ms iteration = 22 status = {}
89652025-02-21T10:08:53.909ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89662025-02-21T10:08:53.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "053ceb36-003d-4cef-9c59-4ab96b791066", "content-length": "810", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89672025-02-21T10:08:53.909ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(2152975) }} sled = sock
89682025-02-21T10:08:53.909ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
89692025-02-21T10:08:53.909ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
89702025-02-21T10:08:53.911ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.949664ms iteration = 22 status = {}
89712025-02-21T10:08:53.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89722025-02-21T10:08:53.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89732025-02-21T10:08:53.942ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
89742025-02-21T10:08:53.942ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89752025-02-21T10:08:53.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89762025-02-21T10:08:53.952ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89772025-02-21T10:08:53.953ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "31eb7f1b-083c-43ea-bee8-52802446566c", "content-length": "134", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89782025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89792025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
89802025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89812025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89822025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89832025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89842025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89852025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89862025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89872025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89882025-02-21T10:08:53.953ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
89892025-02-21T10:08:53.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89902025-02-21T10:08:53.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89912025-02-21T10:08:53.955ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
89922025-02-21T10:08:53.955ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e31eb40d-37de-4080-85f5-1c43674a2153", "content-length": "2", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89932025-02-21T10:08:53.955ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
89942025-02-21T10:08:53.956ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6583c20-ac89-410a-af92-983cc43afb97", "content-length": "52", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
89952025-02-21T10:08:53.956ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
89962025-02-21T10:08:53.956ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89972025-02-21T10:08:54.089ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/9461702b-804b-4ffb-8c5d-095105df14b3/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e00d5ee-3475-4409-ae96-73cdb32a9a2d", "content-length": "131", "date": "Fri, 21 Feb 2025 10:08:54 GMT"} })
89982025-02-21T10:08:54.094ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 5956fc32-6bca-4607-910c-979d540be386 sled_id = 9f7d1cf8-48de-4890-ab3d-e135f2248edc state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-21T10:08:46.350602856Z }, migration_in: None, migration_out: None } vmm_id = 9461702b-804b-4ffb-8c5d-095105df14b3
89992025-02-21T10:08:54.094ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2078 instance_id = 5956fc32-6bca-4607-910c-979d540be386 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9461702b-804b-4ffb-8c5d-095105df14b3 sled_id = 9f7d1cf8-48de-4890-ab3d-e135f2248edc vmm_id = 9461702b-804b-4ffb-8c5d-095105df14b3 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-21T10:08:46.350602856Z }
90002025-02-21T10:08:54.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 5956fc32-6bca-4607-910c-979d540be386 roles = RoleSet { roles: {} } sled_id = 9f7d1cf8-48de-4890-ab3d-e135f2248edc vmm_id = 9461702b-804b-4ffb-8c5d-095105df14b3
90012025-02-21T10:08:54.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 5956fc32-6bca-4607-910c-979d540be386 resource = Database result = Ok(()) sled_id = 9f7d1cf8-48de-4890-ab3d-e135f2248edc vmm_id = 9461702b-804b-4ffb-8c5d-095105df14b3
90022025-02-21T10:08:54.098ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bc8b8d1a-9e9a-4437-a237-3ff448b55077", "date": "Fri, 21 Feb 2025 10:08:53 GMT"} })
90032025-02-21T10:08:54.098ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
90042025-02-21T10:08:54.098ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90052025-02-21T10:08:54.098ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e412c6b-2e98-4db0-a56d-2dd7952e9f5c", "content-length": "682", "date": "Fri, 21 Feb 2025 10:08:54 GMT"} })
90062025-02-21T10:08:54.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90072025-02-21T10:08:54.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90082025-02-21T10:08:54.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90092025-02-21T10:08:54.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90102025-02-21T10:08:54.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90112025-02-21T10:08:54.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90122025-02-21T10:08:54.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90132025-02-21T10:08:54.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90142025-02-21T10:08:54.110ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9461702b-804b-4ffb-8c5d-095105df14b3 remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55184319-6451-441c-8049-4126f5579eab uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-21T10:08:54.090085676Z }
90152025-02-21T10:08:54.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55184319-6451-441c-8049-4126f5579eab roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
90162025-02-21T10:08:54.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55184319-6451-441c-8049-4126f5579eab resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
90172025-02-21T10:08:54.116ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 559.033065ms iteration = 22 status = {}
90182025-02-21T10:08:54.146ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
90192025-02-21T10:08:54.148ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 591.374766ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
90202025-02-21T10:08:54.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 65643 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 55184319-6451-441c-8049-4126f5579eab response_code = 204 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
90212025-02-21T10:08:54.157ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9461702b-804b-4ffb-8c5d-095105df14b3 remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c2f8863a-c72c-4a18-b69d-5ae82627017c uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-21T10:08:54.157192886Z }
90222025-02-21T10:08:54.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c2f8863a-c72c-4a18-b69d-5ae82627017c roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
90232025-02-21T10:08:54.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c2f8863a-c72c-4a18-b69d-5ae82627017c resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
90242025-02-21T10:08:54.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 35559 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c2f8863a-c72c-4a18-b69d-5ae82627017c response_code = 204 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
90252025-02-21T10:08:54.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d9569bbb-762e-4af8-b196-6f89c600da7c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90262025-02-21T10:08:54.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d9569bbb-762e-4af8-b196-6f89c600da7c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90272025-02-21T10:08:54.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2623 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d9569bbb-762e-4af8-b196-6f89c600da7c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90282025-02-21T10:08:55.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eff3e94f-3776-427e-9487-46f3c055e30d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90292025-02-21T10:08:55.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eff3e94f-3776-427e-9487-46f3c055e30d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90302025-02-21T10:08:55.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2856 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eff3e94f-3776-427e-9487-46f3c055e30d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90312025-02-21T10:08:56.548ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5543 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 47f00f34-60a3-4b9d-8069-b032eb8adfee response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
90322025-02-21T10:08:56.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 22bdc7cb-91d7-45c8-9ae4-e2ad08880751 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90332025-02-21T10:08:56.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 22bdc7cb-91d7-45c8-9ae4-e2ad08880751 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90342025-02-21T10:08:56.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 22bdc7cb-91d7-45c8-9ae4-e2ad08880751 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90352025-02-21T10:08:57.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb82d2f3-0def-420c-aabf-cd2d65f0bf48 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90362025-02-21T10:08:57.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb82d2f3-0def-420c-aabf-cd2d65f0bf48 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90372025-02-21T10:08:57.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2402 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cb82d2f3-0def-420c-aabf-cd2d65f0bf48 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90382025-02-21T10:08:58.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4b0a6aab-42d0-474a-9a56-9671c622b607 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90392025-02-21T10:08:58.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4b0a6aab-42d0-474a-9a56-9671c622b607 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90402025-02-21T10:08:58.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4b0a6aab-42d0-474a-9a56-9671c622b607 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90412025-02-21T10:08:59.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3e1fc957-ea17-4561-8cda-ce56f76acb03 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90422025-02-21T10:08:59.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3e1fc957-ea17-4561-8cda-ce56f76acb03 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90432025-02-21T10:08:59.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1940 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3e1fc957-ea17-4561-8cda-ce56f76acb03 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90442025-02-21T10:09:00.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eb4b8ccc-e514-4f15-9cd2-b268af556fbd roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90452025-02-21T10:09:00.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eb4b8ccc-e514-4f15-9cd2-b268af556fbd resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90462025-02-21T10:09:00.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eb4b8ccc-e514-4f15-9cd2-b268af556fbd response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90472025-02-21T10:09:01.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0a0eb5ec-081c-4daf-a0a1-774fcb05fc75 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90482025-02-21T10:09:01.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0a0eb5ec-081c-4daf-a0a1-774fcb05fc75 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90492025-02-21T10:09:01.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0a0eb5ec-081c-4daf-a0a1-774fcb05fc75 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90502025-02-21T10:09:02.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 02c5ffb4-142a-45ff-8d46-bbf625852629 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90512025-02-21T10:09:02.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 02c5ffb4-142a-45ff-8d46-bbf625852629 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90522025-02-21T10:09:02.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2665 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 02c5ffb4-142a-45ff-8d46-bbf625852629 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90532025-02-21T10:09:03.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
90542025-02-21T10:09:03.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90552025-02-21T10:09:03.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
90562025-02-21T10:09:03.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90572025-02-21T10:09:03.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90582025-02-21T10:09:03.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90592025-02-21T10:09:03.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90602025-02-21T10:09:03.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90612025-02-21T10:09:03.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90622025-02-21T10:09:03.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90632025-02-21T10:09:03.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90642025-02-21T10:09:03.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90652025-02-21T10:09:03.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90662025-02-21T10:09:03.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
90672025-02-21T10:09:03.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90682025-02-21T10:09:03.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90692025-02-21T10:09:03.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
90702025-02-21T10:09:03.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.949333ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
90712025-02-21T10:09:03.588ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90722025-02-21T10:09:03.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90732025-02-21T10:09:03.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.762711ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90742025-02-21T10:09:03.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1a7392d2-0e59-4136-b0db-377bb854d24c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90752025-02-21T10:09:03.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1a7392d2-0e59-4136-b0db-377bb854d24c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90762025-02-21T10:09:03.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2742 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1a7392d2-0e59-4136-b0db-377bb854d24c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90772025-02-21T10:09:04.315ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9461702b-804b-4ffb-8c5d-095105df14b3 remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 72e1bc24-5606-4ec2-8bbe-1094c7816017 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-21T10:09:04.314692320Z }
90782025-02-21T10:09:04.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 72e1bc24-5606-4ec2-8bbe-1094c7816017 roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
90792025-02-21T10:09:04.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 72e1bc24-5606-4ec2-8bbe-1094c7816017 resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
90802025-02-21T10:09:04.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 50636 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 72e1bc24-5606-4ec2-8bbe-1094c7816017 response_code = 204 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
90812025-02-21T10:09:04.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 703d31df-227c-4065-8fa5-2a8405e4c50e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90822025-02-21T10:09:04.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 703d31df-227c-4065-8fa5-2a8405e4c50e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90832025-02-21T10:09:04.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2228 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 703d31df-227c-4065-8fa5-2a8405e4c50e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90842025-02-21T10:09:05.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = feca40e7-cbce-4ad1-a02d-8604d83b6853 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
90852025-02-21T10:09:05.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = feca40e7-cbce-4ad1-a02d-8604d83b6853 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
90862025-02-21T10:09:05.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3827 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = feca40e7-cbce-4ad1-a02d-8604d83b6853 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
90872025-02-21T10:09:05.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 6bf8b6b1-078d-4e83-bd83-32fba64273a6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
90882025-02-21T10:09:05.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 6bf8b6b1-078d-4e83-bd83-32fba64273a6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
90892025-02-21T10:09:05.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2853 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 6bf8b6b1-078d-4e83-bd83-32fba64273a6 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
90902025-02-21T10:09:05.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0633addc-3e28-4add-9468-eca82cf354ce roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90912025-02-21T10:09:05.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0633addc-3e28-4add-9468-eca82cf354ce resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90922025-02-21T10:09:05.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1901 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 0633addc-3e28-4add-9468-eca82cf354ce response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
90932025-02-21T10:09:06.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 75044507-8e50-4936-bc84-4143680e35b6 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
90942025-02-21T10:09:06.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 75044507-8e50-4936-bc84-4143680e35b6 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
90952025-02-21T10:09:06.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3670 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 75044507-8e50-4936-bc84-4143680e35b6 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
90962025-02-21T10:09:06.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 84a5ce99-b475-44b6-82ca-26a0e50e6b2f roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
90972025-02-21T10:09:06.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 84a5ce99-b475-44b6-82ca-26a0e50e6b2f resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
90982025-02-21T10:09:06.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 84a5ce99-b475-44b6-82ca-26a0e50e6b2f response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
90992025-02-21T10:09:06.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 622 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 45f61fea-9dd8-4a1f-8f08-2897419421f3 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
91002025-02-21T10:09:06.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 28d0a735-387e-437b-ba2c-6dbff9ec337c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
91012025-02-21T10:09:06.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 28d0a735-387e-437b-ba2c-6dbff9ec337c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
91022025-02-21T10:09:06.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3342 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 28d0a735-387e-437b-ba2c-6dbff9ec337c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
91032025-02-21T10:09:06.775ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9461702b-804b-4ffb-8c5d-095105df14b3 remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-21T10:09:06.775195939Z }
91042025-02-21T10:09:06.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91052025-02-21T10:09:06.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91062025-02-21T10:09:06.817ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 9461702b-804b-4ffb-8c5d-095105df14b3 remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3 vmm_needs_update = true
91072025-02-21T10:09:06.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91082025-02-21T10:09:06.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91092025-02-21T10:09:06.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91102025-02-21T10:09:06.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91112025-02-21T10:09:06.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91122025-02-21T10:09:06.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91132025-02-21T10:09:06.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91142025-02-21T10:09:06.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91152025-02-21T10:09:06.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91162025-02-21T10:09:06.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91172025-02-21T10:09:06.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91182025-02-21T10:09:06.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91192025-02-21T10:09:06.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91202025-02-21T10:09:06.858ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, lookup_type: ById(8b6a13c9-dd06-458f-aa99-e7b6be2edbb8) }, key: 60ca61e7-8b26-4280-a06a-78140ad2c213, lookup_type: ById(60ca61e7-8b26-4280-a06a-78140ad2c213) }, key: 5956fc32-6bca-4607-910c-979d540be386, lookup_type: ById(5956fc32-6bca-4607-910c-979d540be386) } result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91212025-02-21T10:09:06.865ZINFOnexus (dropshot_internal): starting update saga for 5956fc32-6bca-4607-910c-979d540be386 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1545 instance_id = 5956fc32-6bca-4607-910c-979d540be386 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-21T10:09:06.775195939Z }
91222025-02-21T10:09:06.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 90379 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 response_code = 204 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91232025-02-21T10:09:06.866ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 9461702b-804b-4ffb-8c5d-095105df14b3 remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff7f4a79-a115-4937-9117-c567cda84004 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-21T10:09:06.775195939Z }
91242025-02-21T10:09:06.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff7f4a79-a115-4937-9117-c567cda84004 roles = RoleSet { roles: {} } uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91252025-02-21T10:09:06.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff7f4a79-a115-4937-9117-c567cda84004 resource = Database result = Ok(()) uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91262025-02-21T10:09:06.868ZDEBGnexus (dropshot_internal): preparing instance-update saga for 5956fc32-6bca-4607-910c-979d540be386... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 5956fc32-6bca-4607-910c-979d540be386 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 891f1b36-e856-4cf4-b56a-698ca341c2c6 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91272025-02-21T10:09:06.868ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update
91282025-02-21T10:09:06.870ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"5956fc32-6bca-4607-910c-979d540be386","lookup_type":{"ById":"5956fc32-6bca-4607-910c-979d540be386"},"parent":{"key":"60ca61e7-8b26-4280-a06a-78140ad2c213","lookup_type":{"ById":"60ca61e7-8b26-4280-a06a-78140ad2c213"},"parent":{"key":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","lookup_type":{"ById":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91292025-02-21T10:09:06.870ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update
91302025-02-21T10:09:06.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6566 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ff7f4a79-a115-4937-9117-c567cda84004 response_code = 204 uri = /vmms/9461702b-804b-4ffb-8c5d-095105df14b3
91312025-02-21T10:09:06.911ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update
91322025-02-21T10:09:06.913ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91332025-02-21T10:09:06.913ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91342025-02-21T10:09:06.913ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
91352025-02-21T10:09:06.918ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91362025-02-21T10:09:06.918ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
91372025-02-21T10:09:06.922ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91382025-02-21T10:09:06.922ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
91392025-02-21T10:09:06.930ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91402025-02-21T10:09:06.930ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("1b9bf359-ef87-401e-812a-b92d7557fada")) node_id = 0 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
91412025-02-21T10:09:06.933ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91422025-02-21T10:09:06.933ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
91432025-02-21T10:09:06.949ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update
91442025-02-21T10:09:06.952ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91452025-02-21T10:09:06.952ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91462025-02-21T10:09:06.954ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91472025-02-21T10:09:06.954ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91482025-02-21T10:09:06.958ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91492025-02-21T10:09:06.958ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91502025-02-21T10:09:06.960ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91512025-02-21T10:09:06.960ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91522025-02-21T10:09:06.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84c632cf-4971-40c1-81be-b2ad4019f6f9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
91532025-02-21T10:09:06.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84c632cf-4971-40c1-81be-b2ad4019f6f9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
91542025-02-21T10:09:06.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1906 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 84c632cf-4971-40c1-81be-b2ad4019f6f9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
91552025-02-21T10:09:06.992ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91562025-02-21T10:09:06.992ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91572025-02-21T10:09:06.993ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91582025-02-21T10:09:06.993ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91592025-02-21T10:09:06.995ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91602025-02-21T10:09:07.001ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, lookup_type: ById(8b6a13c9-dd06-458f-aa99-e7b6be2edbb8) }, key: 60ca61e7-8b26-4280-a06a-78140ad2c213, lookup_type: ById(60ca61e7-8b26-4280-a06a-78140ad2c213) }, key: 5956fc32-6bca-4607-910c-979d540be386, lookup_type: ById(5956fc32-6bca-4607-910c-979d540be386) } result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91612025-02-21T10:09:07.001ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance updater_id = 1b9bf359-ef87-401e-812a-b92d7557fada
91622025-02-21T10:09:07.001ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91632025-02-21T10:09:07.001ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91642025-02-21T10:09:07.019ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance updater_id = 1b9bf359-ef87-401e-812a-b92d7557fada
91652025-02-21T10:09:07.019ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91662025-02-21T10:09:07.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance
91672025-02-21T10:09:07.023ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 5956fc32-6bca-4607-910c-979d540be386 locked_gen = Generation(Generation(2)) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = LockInstance updater_id = 1b9bf359-ef87-401e-812a-b92d7557fada
91682025-02-21T10:09:07.028ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91692025-02-21T10:09:07.028ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("1b9bf359-ef87-401e-812a-b92d7557fada")}) node_id = 1 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
91702025-02-21T10:09:07.033ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91712025-02-21T10:09:07.033ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
91722025-02-21T10:09:07.039ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
91732025-02-21T10:09:07.039ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
91742025-02-21T10:09:07.040ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
91752025-02-21T10:09:07.040ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
91762025-02-21T10:09:07.042ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
91772025-02-21T10:09:07.042ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
91782025-02-21T10:09:07.044ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
91792025-02-21T10:09:07.047ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, lookup_type: ById(8b6a13c9-dd06-458f-aa99-e7b6be2edbb8) }, key: 60ca61e7-8b26-4280-a06a-78140ad2c213, lookup_type: ById(60ca61e7-8b26-4280-a06a-78140ad2c213) }, key: 5956fc32-6bca-4607-910c-979d540be386, lookup_type: ById(5956fc32-6bca-4607-910c-979d540be386) } result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
91802025-02-21T10:09:07.047ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
91812025-02-21T10:09:07.047ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
91822025-02-21T10:09:07.060ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 9461702b-804b-4ffb-8c5d-095105df14b3, time_created: 2025-02-21T10:08:45.736462Z, time_deleted: None, instance_id: 5956fc32-6bca-4607-910c-979d540be386, sled_id: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-02-21T10:09:06.775195Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-02-21T10:08:43.434061Z, gen: Generation(Generation(3)), propolis_id: Some(9461702b-804b-4ffb-8c5d-095105df14b3), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(9461702b-804b-4ffb-8c5d-095105df14b3 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-02-21T10:09:07.060062136Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
91832025-02-21T10:09:07.064ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
91842025-02-21T10:09:07.064ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"5956fc32-6bca-4607-910c-979d540be386","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"9461702b-804b-4ffb-8c5d-095105df14b3"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"5956fc32-6bca-4607-910c-979d540be386","lookup_type":{"ById":"5956fc32-6bca-4607-910c-979d540be386"},"parent":{"key":"60ca61e7-8b26-4280-a06a-78140ad2c213","lookup_type":{"ById":"60ca61e7-8b26-4280-a06a-78140ad2c213"},"parent":{"key":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","lookup_type":{"ById":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"1b9bf359-ef87-401e-812a-b92d7557fada"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"60ca61e7-8b26-4280-a06a-78140ad2c213","ram_diff":1073741824},"destroy_active_vmm":"9461702b-804b-4ffb-8c5d-095105df14b3","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-02-21T10:09:07.060062136Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91852025-02-21T10:09:07.064ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
91862025-02-21T10:09:07.096ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
91872025-02-21T10:09:07.096ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91882025-02-21T10:09:07.096ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91892025-02-21T10:09:07.096ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
91902025-02-21T10:09:07.100ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91912025-02-21T10:09:07.100ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
91922025-02-21T10:09:07.103ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91932025-02-21T10:09:07.103ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
91942025-02-21T10:09:07.106ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91952025-02-21T10:09:07.106ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ad7cacd1-2985-462a-872e-bfb260e446e2")) node_id = 0 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
91962025-02-21T10:09:07.110ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
91972025-02-21T10:09:07.110ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
91982025-02-21T10:09:07.116ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 5956fc32-6bca-4607-910c-979d540be386 parent_lock = UpdaterLock { updater_id: 1b9bf359-ef87-401e-812a-b92d7557fada, locked_gen: Generation(Generation(2)) } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
91992025-02-21T10:09:07.116ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = BecomeUpdater
92002025-02-21T10:09:07.116ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = BecomeUpdater
92012025-02-21T10:09:07.126ZDEBGnexus (SagaExecutor): inherited lock from 1b9bf359-ef87-401e-812a-b92d7557fada to ad7cacd1-2985-462a-872e-bfb260e446e2 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 5956fc32-6bca-4607-910c-979d540be386 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 1b9bf359-ef87-401e-812a-b92d7557fada saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = BecomeUpdater updater_id = ad7cacd1-2985-462a-872e-bfb260e446e2
92022025-02-21T10:09:07.126ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92032025-02-21T10:09:07.126ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92042025-02-21T10:09:07.126ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ad7cacd1-2985-462a-872e-bfb260e446e2")}) node_id = 1 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92052025-02-21T10:09:07.129ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92062025-02-21T10:09:07.129ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92072025-02-21T10:09:07.132ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92082025-02-21T10:09:07.132ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92092025-02-21T10:09:07.135ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92102025-02-21T10:09:07.135ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92112025-02-21T10:09:07.141ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92122025-02-21T10:09:07.143ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 5956fc32-6bca-4607-910c-979d540be386
92132025-02-21T10:09:07.143ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = UpdateNetworkConfig
92142025-02-21T10:09:07.144ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = UpdateNetworkConfig
92152025-02-21T10:09:07.146ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = UpdateNetworkConfig
92162025-02-21T10:09:07.146ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = UpdateNetworkConfig
92172025-02-21T10:09:07.151ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
92182025-02-21T10:09:07.151ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = UpdateNetworkConfig
92192025-02-21T10:09:07.151ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = UpdateNetworkConfig
92202025-02-21T10:09:07.153ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
92212025-02-21T10:09:07.153ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
92222025-02-21T10:09:07.153ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
92232025-02-21T10:09:07.154ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
92242025-02-21T10:09:07.155ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
92252025-02-21T10:09:07.155ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
92262025-02-21T10:09:07.156ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
92272025-02-21T10:09:07.161ZDEBGnexus: notifying dendrite of updates instance_id = Some(5956fc32-6bca-4607-910c-979d540be386 (instance)) switch = switch0
92282025-02-21T10:09:07.161ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1745, tv_nsec: 460299564 } })
92292025-02-21T10:09:07.161ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1154
92302025-02-21T10:09:07.192ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
92312025-02-21T10:09:07.192ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92322025-02-21T10:09:07.192ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6adc5853-2813-403a-a600-eb2d9a3dfaa6", "content-length": "26", "date": "Fri, 21 Feb 2025 10:09:07 GMT"} })
92332025-02-21T10:09:07.192ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92342025-02-21T10:09:07.193ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92352025-02-21T10:09:07.223ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
92362025-02-21T10:09:07.223ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "f50c5c6c-ef23-435c-a573-53c0fe251405", "content-length": "4", "date": "Fri, 21 Feb 2025 10:09:06 GMT"} })
92372025-02-21T10:09:07.223ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92382025-02-21T10:09:07.223ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92392025-02-21T10:09:07.228ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92402025-02-21T10:09:07.228ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92412025-02-21T10:09:07.235ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
92422025-02-21T10:09:07.236ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
92432025-02-21T10:09:07.252ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 5956fc32-6bca-4607-910c-979d540be386 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-02-21T10:09:07.241025Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 60ca61e7-8b26-4280-a06a-78140ad2c213, time_modified: Some(2025-02-21T10:09:07.241025Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, time_modified: Some(2025-02-21T10:09:07.241025Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92442025-02-21T10:09:07.252ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92452025-02-21T10:09:07.252ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92462025-02-21T10:09:07.256ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92472025-02-21T10:09:07.256ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92482025-02-21T10:09:07.262ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92492025-02-21T10:09:07.262ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = UnassignOximeterProducer
92502025-02-21T10:09:07.262ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = UnassignOximeterProducer
92512025-02-21T10:09:07.271ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 8d248760-b8d2-4503-94cf-92f282d79332 producer_id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92522025-02-21T10:09:07.271ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = UnassignOximeterProducer
92532025-02-21T10:09:07.271ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = UnassignOximeterProducer
92542025-02-21T10:09:07.308ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92552025-02-21T10:09:07.308ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/5956fc32-6bca-4607-910c-979d540be386
92562025-02-21T10:09:07.332ZDEBGnexus (SagaExecutor): client response oximeter-collector = 5956fc32-6bca-4607-910c-979d540be386 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/5956fc32-6bca-4607-910c-979d540be386", status: 204, headers: {"x-request-id": "95894e3e-d328-4eac-bf17-4b928410121b", "date": "Fri, 21 Feb 2025 10:09:07 GMT"} }) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92572025-02-21T10:09:07.332ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 8d248760-b8d2-4503-94cf-92f282d79332 producer_id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92582025-02-21T10:09:07.335ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92592025-02-21T10:09:07.335ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92602025-02-21T10:09:07.338ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92612025-02-21T10:09:07.338ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92622025-02-21T10:09:07.342ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 5956fc32-6bca-4607-910c-979d540be386 lock = UpdaterLock { updater_id: ad7cacd1-2985-462a-872e-bfb260e446e2, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-02-21T10:09:07.060062136Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92632025-02-21T10:09:07.342ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = CommitInstanceUpdates
92642025-02-21T10:09:07.342ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = CommitInstanceUpdates
92652025-02-21T10:09:07.388ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 5956fc32-6bca-4607-910c-979d540be386 new_runtime = InstanceRuntimeState { time_updated: 2025-02-21T10:09:07.060062136Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92662025-02-21T10:09:07.388ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92672025-02-21T10:09:07.388ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92682025-02-21T10:09:07.388ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Signaled
92692025-02-21T10:09:07.388ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92702025-02-21T10:09:07.388ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Signaled
92712025-02-21T10:09:07.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92722025-02-21T10:09:07.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92732025-02-21T10:09:07.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92742025-02-21T10:09:07.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92752025-02-21T10:09:07.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92762025-02-21T10:09:07.391ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92772025-02-21T10:09:07.391ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92782025-02-21T10:09:07.392ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92792025-02-21T10:09:07.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92802025-02-21T10:09:07.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92812025-02-21T10:09:07.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92822025-02-21T10:09:07.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92832025-02-21T10:09:07.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92842025-02-21T10:09:07.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92852025-02-21T10:09:07.397ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92862025-02-21T10:09:07.397ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("5956fc32-6bca-4607-910c-979d540be386"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("9461702b-804b-4ffb-8c5d-095105df14b3")}) node_id = 7 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92872025-02-21T10:09:07.403ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92882025-02-21T10:09:07.403ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92892025-02-21T10:09:07.407ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92902025-02-21T10:09:07.407ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92912025-02-21T10:09:07.411ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92922025-02-21T10:09:07.411ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92932025-02-21T10:09:07.414ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 5956fc32-6bca-4607-910c-979d540be386 propolis_id = 9461702b-804b-4ffb-8c5d-095105df14b3 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
92942025-02-21T10:09:07.414ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ReleaseSledResources
92952025-02-21T10:09:07.415ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ReleaseSledResources
92962025-02-21T10:09:07.419ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92972025-02-21T10:09:07.419ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
92982025-02-21T10:09:07.423ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
92992025-02-21T10:09:07.423ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
93002025-02-21T10:09:07.427ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 5956fc32-6bca-4607-910c-979d540be386 propolis_id = 9461702b-804b-4ffb-8c5d-095105df14b3 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
93012025-02-21T10:09:07.428ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = MarkVmmDeleted
93022025-02-21T10:09:07.428ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = MarkVmmDeleted
93032025-02-21T10:09:07.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93042025-02-21T10:09:07.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93052025-02-21T10:09:07.437ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93062025-02-21T10:09:07.437ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
93072025-02-21T10:09:07.442ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93082025-02-21T10:09:07.442ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
93092025-02-21T10:09:07.446ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93102025-02-21T10:09:07.446ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
93112025-02-21T10:09:07.450ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93122025-02-21T10:09:07.450ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
93132025-02-21T10:09:07.456ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ChainSuccessorSaga
93142025-02-21T10:09:07.457ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ChainSuccessorSaga
93152025-02-21T10:09:07.492ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ChainSuccessorSaga
93162025-02-21T10:09:07.493ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ChainSuccessorSaga
93172025-02-21T10:09:07.497ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93182025-02-21T10:09:07.497ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93192025-02-21T10:09:07.498ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f6f64ee-0815-4d22-bac2-6b87030eb0f8", "content-length": "372", "date": "Fri, 21 Feb 2025 10:09:07 GMT"} })
93202025-02-21T10:09:07.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93212025-02-21T10:09:07.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93222025-02-21T10:09:07.512ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
93232025-02-21T10:09:07.512ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93242025-02-21T10:09:07.513ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "906864e3-3da6-49af-9fe6-30a891c04781", "date": "Fri, 21 Feb 2025 10:09:07 GMT"} })
93252025-02-21T10:09:07.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93262025-02-21T10:09:07.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93272025-02-21T10:09:07.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93282025-02-21T10:09:07.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93292025-02-21T10:09:07.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93302025-02-21T10:09:07.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93312025-02-21T10:09:07.521ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93322025-02-21T10:09:07.521ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93332025-02-21T10:09:07.522ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "18406973-ff90-4f7c-b179-3e821b9df3e8", "date": "Fri, 21 Feb 2025 10:09:06 GMT"} })
93342025-02-21T10:09:07.523ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 135.44608ms iteration = 23 status = {}
93352025-02-21T10:09:07.525ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93362025-02-21T10:09:07.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93372025-02-21T10:09:07.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93382025-02-21T10:09:07.528ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ChainSuccessorSaga
93392025-02-21T10:09:07.528ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ChainSuccessorSaga
93402025-02-21T10:09:07.529ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93412025-02-21T10:09:07.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93422025-02-21T10:09:07.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93432025-02-21T10:09:07.529ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ChainSuccessorSaga
93442025-02-21T10:09:07.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93452025-02-21T10:09:07.533ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93462025-02-21T10:09:07.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93472025-02-21T10:09:07.533ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, lookup_type: ById(8b6a13c9-dd06-458f-aa99-e7b6be2edbb8) }, key: 60ca61e7-8b26-4280-a06a-78140ad2c213, lookup_type: ById(60ca61e7-8b26-4280-a06a-78140ad2c213) }, key: 5956fc32-6bca-4607-910c-979d540be386, lookup_type: ById(5956fc32-6bca-4607-910c-979d540be386) } result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ChainSuccessorSaga
93482025-02-21T10:09:07.533ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ChainSuccessorSaga
93492025-02-21T10:09:07.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93502025-02-21T10:09:07.533ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_node = ChainSuccessorSaga
93512025-02-21T10:09:07.539ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 5956fc32-6bca-4607-910c-979d540be386 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update
93522025-02-21T10:09:07.539ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93532025-02-21T10:09:07.539ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
93542025-02-21T10:09:07.542ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93552025-02-21T10:09:07.542ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
93562025-02-21T10:09:07.546ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93572025-02-21T10:09:07.546ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
93582025-02-21T10:09:07.548ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93592025-02-21T10:09:07.548ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0
93602025-02-21T10:09:07.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 15c77f05-f15e-4a84-ab06-c20d3115084a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
93612025-02-21T10:09:07.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 15c77f05-f15e-4a84-ab06-c20d3115084a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
93622025-02-21T10:09:07.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2701 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 15c77f05-f15e-4a84-ab06-c20d3115084a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
93632025-02-21T10:09:07.591ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93642025-02-21T10:09:07.593ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 saga_name = instance-update saga_result = SagaResult { saga_id: 7d280947-76b1-4561-a88f-bf365bf753e0, saga_log: SagaLog { saga_id: 7d280947-76b1-4561-a88f-bf365bf753e0, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("ad7cacd1-2985-462a-872e-bfb260e446e2")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ad7cacd1-2985-462a-872e-bfb260e446e2")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("5956fc32-6bca-4607-910c-979d540be386"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("9461702b-804b-4ffb-8c5d-095105df14b3")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("5956fc32-6bca-4607-910c-979d540be386"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("9461702b-804b-4ffb-8c5d-095105df14b3")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("ad7cacd1-2985-462a-872e-bfb260e446e2"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("ad7cacd1-2985-462a-872e-bfb260e446e2")}} }) }
93652025-02-21T10:09:07.593ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 7d280947-76b1-4561-a88f-bf365bf753e0 instance_id = 5956fc32-6bca-4607-910c-979d540be386 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update
93662025-02-21T10:09:07.593ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93672025-02-21T10:09:07.593ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
93682025-02-21T10:09:07.598ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93692025-02-21T10:09:07.598ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
93702025-02-21T10:09:07.602ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93712025-02-21T10:09:07.602ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
93722025-02-21T10:09:07.605ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93732025-02-21T10:09:07.605ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f
93742025-02-21T10:09:07.630ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93752025-02-21T10:09:07.630ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b8865cf-7577-41c0-b0f3-de1d2de8b300", "content-length": "691", "date": "Fri, 21 Feb 2025 10:09:07 GMT"} })
93762025-02-21T10:09:07.630ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
93772025-02-21T10:09:07.630ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
93782025-02-21T10:09:07.630ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
93792025-02-21T10:09:07.632ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 244.689497ms iteration = 23 status = {}
93802025-02-21T10:09:07.637ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update sec_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
93812025-02-21T10:09:07.637ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 6fdd11fd-5289-4ffc-9095-8a6c52d8231f saga_name = start-instance-update saga_result = SagaResult { saga_id: 6fdd11fd-5289-4ffc-9095-8a6c52d8231f, saga_log: SagaLog { saga_id: 6fdd11fd-5289-4ffc-9095-8a6c52d8231f, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("1b9bf359-ef87-401e-812a-b92d7557fada")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("1b9bf359-ef87-401e-812a-b92d7557fada")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("1b9bf359-ef87-401e-812a-b92d7557fada"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("1b9bf359-ef87-401e-812a-b92d7557fada")}} }) }
93822025-02-21T10:09:07.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49578a06-7e87-495b-aac5-0a2ce7bce6fb roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93832025-02-21T10:09:07.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49578a06-7e87-495b-aac5-0a2ce7bce6fb resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93842025-02-21T10:09:07.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2564 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 49578a06-7e87-495b-aac5-0a2ce7bce6fb response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93852025-02-21T10:09:09.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29bd290d-01d1-4bce-b2c9-70e2fa1d8c0a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93862025-02-21T10:09:09.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29bd290d-01d1-4bce-b2c9-70e2fa1d8c0a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93872025-02-21T10:09:09.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1569 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 29bd290d-01d1-4bce-b2c9-70e2fa1d8c0a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93882025-02-21T10:09:09.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 76823eae-fe30-4dbc-a01c-fbf207110b50 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
93892025-02-21T10:09:09.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 76823eae-fe30-4dbc-a01c-fbf207110b50 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
93902025-02-21T10:09:09.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3266 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 76823eae-fe30-4dbc-a01c-fbf207110b50 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
93912025-02-21T10:09:10.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d2d700ea-56d8-4e97-9ce8-16c3d8bf6590 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93922025-02-21T10:09:10.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d2d700ea-56d8-4e97-9ce8-16c3d8bf6590 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93932025-02-21T10:09:10.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1940 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d2d700ea-56d8-4e97-9ce8-16c3d8bf6590 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93942025-02-21T10:09:11.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 69786fa4-c81f-47df-a271-175453b7ce76 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93952025-02-21T10:09:11.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 69786fa4-c81f-47df-a271-175453b7ce76 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93962025-02-21T10:09:11.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 69786fa4-c81f-47df-a271-175453b7ce76 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93972025-02-21T10:09:12.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 669451a4-8bd3-49b7-a753-e9b81c30ff72 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93982025-02-21T10:09:12.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 669451a4-8bd3-49b7-a753-e9b81c30ff72 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
93992025-02-21T10:09:12.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 669451a4-8bd3-49b7-a753-e9b81c30ff72 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94002025-02-21T10:09:13.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8e4ccc05-a8c2-4e33-88c3-a77ea99eb42c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94012025-02-21T10:09:13.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8e4ccc05-a8c2-4e33-88c3-a77ea99eb42c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94022025-02-21T10:09:13.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 8e4ccc05-a8c2-4e33-88c3-a77ea99eb42c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94032025-02-21T10:09:13.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
94042025-02-21T10:09:13.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
94052025-02-21T10:09:13.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94062025-02-21T10:09:13.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94072025-02-21T10:09:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94082025-02-21T10:09:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94092025-02-21T10:09:13.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94102025-02-21T10:09:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94112025-02-21T10:09:13.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94122025-02-21T10:09:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94132025-02-21T10:09:13.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94142025-02-21T10:09:13.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94152025-02-21T10:09:13.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162025-02-21T10:09:13.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
94172025-02-21T10:09:13.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94182025-02-21T10:09:13.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94192025-02-21T10:09:13.581ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
94202025-02-21T10:09:13.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.315523ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
94212025-02-21T10:09:13.594ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94222025-02-21T10:09:13.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94232025-02-21T10:09:13.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.464208ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94242025-02-21T10:09:14.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 89eb2169-7373-4ade-ae6f-ea349f06c147 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94252025-02-21T10:09:14.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 89eb2169-7373-4ade-ae6f-ea349f06c147 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94262025-02-21T10:09:14.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 89eb2169-7373-4ade-ae6f-ea349f06c147 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94272025-02-21T10:09:15.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 667954ac-099c-4b87-9b04-2919d7328bde roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94282025-02-21T10:09:15.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 667954ac-099c-4b87-9b04-2919d7328bde resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94292025-02-21T10:09:15.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 667954ac-099c-4b87-9b04-2919d7328bde response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94302025-02-21T10:09:16.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 198f10f3-b66b-466b-a4a3-fbb1c6402f37 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94312025-02-21T10:09:16.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 198f10f3-b66b-466b-a4a3-fbb1c6402f37 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94322025-02-21T10:09:16.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2651 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 198f10f3-b66b-466b-a4a3-fbb1c6402f37 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94332025-02-21T10:09:16.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 689 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = fc1ff619-4568-4a13-a87b-21a4a5615dc4 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
94342025-02-21T10:09:17.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a08b352c-5510-41c3-807d-547156cd490a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94352025-02-21T10:09:17.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a08b352c-5510-41c3-807d-547156cd490a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94362025-02-21T10:09:17.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a08b352c-5510-41c3-807d-547156cd490a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94372025-02-21T10:09:18.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f79cd6a2-0d5a-42bf-9baf-b0927816414d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94382025-02-21T10:09:18.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f79cd6a2-0d5a-42bf-9baf-b0927816414d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94392025-02-21T10:09:18.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f79cd6a2-0d5a-42bf-9baf-b0927816414d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94402025-02-21T10:09:19.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3e8baae8-aec2-43ac-9342-53dc2f31f42c roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94412025-02-21T10:09:19.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3e8baae8-aec2-43ac-9342-53dc2f31f42c resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94422025-02-21T10:09:19.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 3e8baae8-aec2-43ac-9342-53dc2f31f42c response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94432025-02-21T10:09:20.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9b823a37-8e88-4eb7-b55a-8e19260efd4f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94442025-02-21T10:09:20.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9b823a37-8e88-4eb7-b55a-8e19260efd4f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94452025-02-21T10:09:20.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2565 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 9b823a37-8e88-4eb7-b55a-8e19260efd4f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94462025-02-21T10:09:21.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a387980f-ffe7-4bb8-8f3e-f2db5b7d46ce roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94472025-02-21T10:09:21.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a387980f-ffe7-4bb8-8f3e-f2db5b7d46ce resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94482025-02-21T10:09:21.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a387980f-ffe7-4bb8-8f3e-f2db5b7d46ce response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94492025-02-21T10:09:22.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 08ba4ad3-b5e6-4567-86fd-d07adcfc7faf roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94502025-02-21T10:09:22.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 08ba4ad3-b5e6-4567-86fd-d07adcfc7faf resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94512025-02-21T10:09:22.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 08ba4ad3-b5e6-4567-86fd-d07adcfc7faf response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94522025-02-21T10:09:23.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ec31c2a3-749e-4f3d-bf82-b9353f113dd8 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94532025-02-21T10:09:23.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ec31c2a3-749e-4f3d-bf82-b9353f113dd8 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94542025-02-21T10:09:23.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2561 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ec31c2a3-749e-4f3d-bf82-b9353f113dd8 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
94552025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
94562025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
94572025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
94582025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94592025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94602025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
94612025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
94622025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94632025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
94642025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
94652025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
94662025-02-21T10:09:23.557ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041
94672025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
94682025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.99\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041"}
94692025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
94702025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
94712025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94722025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
94732025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
94742025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94752025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
94762025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
94772025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94782025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
94792025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
94802025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
94812025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
94822025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94832025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
94842025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94852025-02-21T10:09:23.557ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
94862025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94872025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
94882025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
94892025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
94902025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94912025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
94922025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
94932025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
94942025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94952025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
94962025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
94972025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
94982025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
94992025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95002025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
95012025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
95022025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95032025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
95042025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95052025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
95062025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95072025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
95082025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95092025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
95102025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95112025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
95122025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
95132025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
95142025-02-21T10:09:23.557ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
95152025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
95162025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
95172025-02-21T10:09:23.557ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-21 09:59:23.557890942 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
95182025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
95192025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
95202025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
95212025-02-21T10:09:23.557ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
95222025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95232025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
95242025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
95252025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
95262025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95272025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95282025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
95292025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
95302025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
95312025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95322025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95332025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95342025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95352025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95362025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
95372025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95382025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95392025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
95402025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95412025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95422025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
95432025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
95442025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
95452025-02-21T10:09:23.558ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3bf841e1-42b9-4bd7-ac20-7644b8a83464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5eee7a17-bcfb-4922-9f12-263ce2aa9c0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1761, tv_nsec: 857118070 } })
95462025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
95472025-02-21T10:09:23.558ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d154e9e-6d90-4040-b311-004f0e299e85.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e63432d-4205-48df-bd2b-03a054e87ab0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce82115d-ad7a-41de-a2e8-68ed2ed5c579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1761, tv_nsec: 857141190 } })
95482025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
95492025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
95502025-02-21T10:09:23.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.210279ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
95512025-02-21T10:09:23.559ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
95522025-02-21T10:09:23.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.595899ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
95532025-02-21T10:09:23.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95542025-02-21T10:09:23.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95552025-02-21T10:09:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95562025-02-21T10:09:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
95572025-02-21T10:09:23.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95582025-02-21T10:09:23.561ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95592025-02-21T10:09:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95602025-02-21T10:09:23.562ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.863457ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
95612025-02-21T10:09:23.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95622025-02-21T10:09:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95632025-02-21T10:09:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
95642025-02-21T10:09:23.563ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
95652025-02-21T10:09:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
95662025-02-21T10:09:23.565ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95672025-02-21T10:09:23.566ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.544766ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
95682025-02-21T10:09:23.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95692025-02-21T10:09:23.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
95702025-02-21T10:09:23.567ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95712025-02-21T10:09:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95722025-02-21T10:09:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
95732025-02-21T10:09:23.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95742025-02-21T10:09:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95752025-02-21T10:09:23.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1761, tv_nsec: 867887969 } })
95762025-02-21T10:09:23.569ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
95772025-02-21T10:09:23.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95782025-02-21T10:09:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95792025-02-21T10:09:23.572ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1761, tv_nsec: 870709517 } })
95802025-02-21T10:09:23.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95812025-02-21T10:09:23.572ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
95822025-02-21T10:09:23.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95832025-02-21T10:09:23.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95842025-02-21T10:09:23.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95852025-02-21T10:09:23.577ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-21 09:59:23.557890942 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
95862025-02-21T10:09:23.577ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.688455ms iteration = 12 status = {"expiration":"2025-02-21T09:59:23.557890942Z","pruned":[]}
95872025-02-21T10:09:23.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95882025-02-21T10:09:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95892025-02-21T10:09:23.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95902025-02-21T10:09:23.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95912025-02-21T10:09:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95922025-02-21T10:09:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95932025-02-21T10:09:23.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95942025-02-21T10:09:23.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1761, tv_nsec: 883213769 } })
95952025-02-21T10:09:23.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
95962025-02-21T10:09:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
95972025-02-21T10:09:23.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95982025-02-21T10:09:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95992025-02-21T10:09:23.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96002025-02-21T10:09:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96012025-02-21T10:09:23.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96022025-02-21T10:09:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96032025-02-21T10:09:23.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96042025-02-21T10:09:23.594ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96052025-02-21T10:09:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96062025-02-21T10:09:23.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96072025-02-21T10:09:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
96082025-02-21T10:09:23.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96092025-02-21T10:09:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96102025-02-21T10:09:23.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96112025-02-21T10:09:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
96122025-02-21T10:09:23.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96132025-02-21T10:09:23.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.713326ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
96142025-02-21T10:09:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96152025-02-21T10:09:23.600ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96162025-02-21T10:09:23.600ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
96172025-02-21T10:09:23.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96182025-02-21T10:09:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96192025-02-21T10:09:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
96202025-02-21T10:09:23.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96212025-02-21T10:09:23.601ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 44.185626ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
96222025-02-21T10:09:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96232025-02-21T10:09:23.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96242025-02-21T10:09:23.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96252025-02-21T10:09:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96262025-02-21T10:09:23.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96272025-02-21T10:09:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96282025-02-21T10:09:23.606ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96292025-02-21T10:09:23.606ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
96302025-02-21T10:09:23.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96312025-02-21T10:09:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96322025-02-21T10:09:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96332025-02-21T10:09:23.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96342025-02-21T10:09:23.607ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
96352025-02-21T10:09:23.607ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
96362025-02-21T10:09:23.607ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 49.557606ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
96372025-02-21T10:09:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96382025-02-21T10:09:23.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.351446ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96392025-02-21T10:09:23.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96402025-02-21T10:09:23.610ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
96412025-02-21T10:09:23.610ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.578559ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
96422025-02-21T10:09:23.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96432025-02-21T10:09:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96442025-02-21T10:09:23.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96452025-02-21T10:09:23.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96462025-02-21T10:09:23.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96472025-02-21T10:09:23.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96482025-02-21T10:09:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96492025-02-21T10:09:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96502025-02-21T10:09:23.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96512025-02-21T10:09:23.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.229538ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
96522025-02-21T10:09:23.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96532025-02-21T10:09:23.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96542025-02-21T10:09:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96552025-02-21T10:09:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96562025-02-21T10:09:23.617ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96572025-02-21T10:09:23.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 60.47984ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
96582025-02-21T10:09:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96592025-02-21T10:09:23.620ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96602025-02-21T10:09:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96612025-02-21T10:09:23.629ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96622025-02-21T10:09:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96632025-02-21T10:09:23.635ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96642025-02-21T10:09:23.636ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
96652025-02-21T10:09:23.636ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.557986ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
96662025-02-21T10:09:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
96672025-02-21T10:09:23.638ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96682025-02-21T10:09:23.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96692025-02-21T10:09:23.647ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
96702025-02-21T10:09:23.647ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
96712025-02-21T10:09:23.647ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
96722025-02-21T10:09:23.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96732025-02-21T10:09:23.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96742025-02-21T10:09:23.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96752025-02-21T10:09:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96762025-02-21T10:09:23.654ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96772025-02-21T10:09:23.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
96782025-02-21T10:09:23.656ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96792025-02-21T10:09:23.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96802025-02-21T10:09:23.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96812025-02-21T10:09:23.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96822025-02-21T10:09:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96832025-02-21T10:09:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96842025-02-21T10:09:23.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.609727ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
96852025-02-21T10:09:23.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96862025-02-21T10:09:23.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96872025-02-21T10:09:23.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96882025-02-21T10:09:23.663ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96892025-02-21T10:09:23.663ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
96902025-02-21T10:09:23.663ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.372837ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
96912025-02-21T10:09:23.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.897265ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
96922025-02-21T10:09:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
96932025-02-21T10:09:23.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96942025-02-21T10:09:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96952025-02-21T10:09:23.667ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.286138ms iteration = 23 status = 0
96962025-02-21T10:09:23.669ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
96972025-02-21T10:09:23.669ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
96982025-02-21T10:09:23.669ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
96992025-02-21T10:09:23.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97002025-02-21T10:09:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97012025-02-21T10:09:23.670ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
97022025-02-21T10:09:23.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97032025-02-21T10:09:23.672ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
97042025-02-21T10:09:23.672ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 114.509624ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
97052025-02-21T10:09:23.673ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97062025-02-21T10:09:23.673ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97072025-02-21T10:09:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97082025-02-21T10:09:23.673ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 115.940359ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97092025-02-21T10:09:23.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97102025-02-21T10:09:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97112025-02-21T10:09:23.675ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
97122025-02-21T10:09:23.675ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
97132025-02-21T10:09:23.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97142025-02-21T10:09:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97152025-02-21T10:09:23.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97162025-02-21T10:09:23.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97172025-02-21T10:09:23.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97182025-02-21T10:09:23.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97192025-02-21T10:09:23.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97202025-02-21T10:09:23.682ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 00d8cc27-a562-42d3-abb6-ccd16fd1b976 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
97212025-02-21T10:09:23.682ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
97222025-02-21T10:09:23.682ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-21 09:58:29.164998 UTC dns_group = internal generation = 1
97232025-02-21T10:09:23.682ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 125.244173ms iteration = 12 status = {"generation":1}
97242025-02-21T10:09:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97252025-02-21T10:09:23.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97262025-02-21T10:09:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97272025-02-21T10:09:23.685ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
97282025-02-21T10:09:23.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
97292025-02-21T10:09:23.707ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97302025-02-21T10:09:23.707ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "58928e48-75fb-41d0-a485-26f6287fc64e", "content-length": "26", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} })
97312025-02-21T10:09:23.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97322025-02-21T10:09:23.709ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
97332025-02-21T10:09:23.709ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97342025-02-21T10:09:23.709ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3235964-a130-4a37-94b4-0f2d42263099", "content-length": "26", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} })
97352025-02-21T10:09:23.709ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97362025-02-21T10:09:23.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97372025-02-21T10:09:23.710ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97382025-02-21T10:09:23.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97392025-02-21T10:09:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97402025-02-21T10:09:23.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97412025-02-21T10:09:23.713ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
97422025-02-21T10:09:23.713ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 0 version = 2
97432025-02-21T10:09:23.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97442025-02-21T10:09:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97452025-02-21T10:09:23.714ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97462025-02-21T10:09:23.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97472025-02-21T10:09:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97482025-02-21T10:09:23.715ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-21T09:58:18.895783Z, time_modified: 2025-02-21T09:58:18.895783Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, db_silo: Silo { identity: SiloIdentity { id: 8b6a13c9-dd06-458f-aa99-e7b6be2edbb8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-21T09:58:29.678734Z, time_modified: 2025-02-21T09:58:29.678734Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
97492025-02-21T10:09:23.715ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.851011ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]}},"default_endpoint":{"silo_id":"8b6a13c9-dd06-458f-aa99-e7b6be2edbb8","tls_certs":["c54c4805fac9d440e68d87afe8ecd9afbf95b2f516621589094dc3d162f8d740"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
97502025-02-21T10:09:23.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97512025-02-21T10:09:23.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97522025-02-21T10:09:23.718ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97532025-02-21T10:09:23.718ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97542025-02-21T10:09:23.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97552025-02-21T10:09:23.718ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
97562025-02-21T10:09:23.718ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97572025-02-21T10:09:23.718ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae90087c-4a03-4be8-81ac-23b309be824f", "content-length": "26", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} })
97582025-02-21T10:09:23.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97592025-02-21T10:09:23.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97602025-02-21T10:09:23.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97612025-02-21T10:09:23.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97622025-02-21T10:09:23.721ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6b7bb8bd-a8f4-4ac0-84f8-553630af2720 dns_zone_name = oxide.test found_so_far = 1 version = 2
97632025-02-21T10:09:23.721ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
97642025-02-21T10:09:23.721ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-21 09:58:29.727106 UTC dns_group = external generation = 2
97652025-02-21T10:09:23.721ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 163.712061ms iteration = 12 status = {"generation":2}
97662025-02-21T10:09:23.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
97672025-02-21T10:09:23.730ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 172.581106ms iteration = 26 status = {"physical_disks_added":0}
97682025-02-21T10:09:23.763ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
97692025-02-21T10:09:23.763ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 205.774938ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
97702025-02-21T10:09:23.828ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
97712025-02-21T10:09:23.828ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6393e70f-2c20-4ccb-9611-def76bdcab32", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
97722025-02-21T10:09:23.828ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
97732025-02-21T10:09:23.830ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "610f566a-4e80-4b61-84c8-c7a5b389f6c2", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
97742025-02-21T10:09:23.830ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
97752025-02-21T10:09:23.831ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
97762025-02-21T10:09:23.832ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 274.278091ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
97772025-02-21T10:09:23.855ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
97782025-02-21T10:09:23.855ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
97792025-02-21T10:09:23.856ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6332b70f-e07b-40c6-b3cf-5dc7c70e47d2", "content-length": "372", "date": "Fri, 21 Feb 2025 10:09:22 GMT"} })
97802025-02-21T10:09:23.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97812025-02-21T10:09:23.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97822025-02-21T10:09:23.866ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
97832025-02-21T10:09:23.869ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
97842025-02-21T10:09:23.869ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
97852025-02-21T10:09:23.870ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4fd3b24e-4683-4788-bef1-f8eb3ee2032d", "date": "Fri, 21 Feb 2025 10:09:22 GMT"} })
97862025-02-21T10:09:23.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97872025-02-21T10:09:23.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97882025-02-21T10:09:23.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97892025-02-21T10:09:23.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97902025-02-21T10:09:23.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97912025-02-21T10:09:23.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97922025-02-21T10:09:23.883ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 325.849266ms iteration = 23 status = {}
97932025-02-21T10:09:23.886ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
97942025-02-21T10:09:23.887ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "15760bc2-d603-419b-80ec-02a8d2e47b4c", "content-length": "691", "date": "Fri, 21 Feb 2025 10:09:22 GMT"} })
97952025-02-21T10:09:23.887ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
97962025-02-21T10:09:23.887ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
97972025-02-21T10:09:23.887ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
97982025-02-21T10:09:23.887ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
97992025-02-21T10:09:23.887ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9bbc582-ec49-45ef-b298-a524a747f202", "content-length": "2", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} })
98002025-02-21T10:09:23.889ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 331.760039ms iteration = 24 status = {}
98012025-02-21T10:09:23.889ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98022025-02-21T10:09:23.889ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98032025-02-21T10:09:23.889ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98042025-02-21T10:09:23.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98052025-02-21T10:09:23.890ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "afa1830c-72f9-4b2b-8da5-a4818a778471", "date": "Fri, 21 Feb 2025 10:09:22 GMT"} })
98062025-02-21T10:09:23.891ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 333.828969ms iteration = 24 status = {}
98072025-02-21T10:09:23.891ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 334.093885ms iteration = 23 status = null
98082025-02-21T10:09:23.935ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98092025-02-21T10:09:23.935ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "176aec8b-15b3-4d4e-b31c-795b44a16080", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98102025-02-21T10:09:23.935ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98112025-02-21T10:09:23.937ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8e1b9650-78f8-43df-8d5f-fbab1bcfa3b7", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98122025-02-21T10:09:23.937ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98132025-02-21T10:09:23.938ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0fc9f70b-e5a6-40c3-bc65-2918c56b2790", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98142025-02-21T10:09:23.938ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98152025-02-21T10:09:23.940ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98162025-02-21T10:09:23.940ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 383.060868ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
98172025-02-21T10:09:23.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98182025-02-21T10:09:23.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98192025-02-21T10:09:23.967ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
98202025-02-21T10:09:23.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98212025-02-21T10:09:23.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98222025-02-21T10:09:23.977ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
98232025-02-21T10:09:23.977ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6966efd4-27bf-4dc3-8d54-15f39e4fb8fe", "content-length": "134", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} })
98242025-02-21T10:09:23.977ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
98252025-02-21T10:09:23.977ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
98262025-02-21T10:09:23.978ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
98272025-02-21T10:09:23.978ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
98282025-02-21T10:09:23.978ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98292025-02-21T10:09:23.978ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98302025-02-21T10:09:23.978ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98312025-02-21T10:09:23.978ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98322025-02-21T10:09:23.978ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98332025-02-21T10:09:23.978ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98342025-02-21T10:09:23.978ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
98352025-02-21T10:09:23.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98362025-02-21T10:09:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98372025-02-21T10:09:23.980ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
98382025-02-21T10:09:23.980ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "716d89c4-0441-4704-90cc-d4a5876efa09", "content-length": "2", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} })
98392025-02-21T10:09:23.980ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
98402025-02-21T10:09:23.980ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f046956-da45-4341-a625-35bc9dd4d32b", "content-length": "52", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} })
98412025-02-21T10:09:23.980ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
98422025-02-21T10:09:23.980ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98432025-02-21T10:09:24.078ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dd74f4d3-0fe6-48a1-a606-690e018d6dbe", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} })
98442025-02-21T10:09:24.078ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
98452025-02-21T10:09:24.078ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
98462025-02-21T10:09:24.079ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7076818d-1f88-4196-a234-eb90c37987ac", "content-length": "682", "date": "Fri, 21 Feb 2025 10:09:23 GMT"} })
98472025-02-21T10:09:24.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98482025-02-21T10:09:24.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98492025-02-21T10:09:24.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98502025-02-21T10:09:24.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98512025-02-21T10:09:24.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98522025-02-21T10:09:24.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98532025-02-21T10:09:24.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98542025-02-21T10:09:24.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98552025-02-21T10:09:24.096ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 539.141755ms iteration = 23 status = {}
98562025-02-21T10:09:24.347ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
98572025-02-21T10:09:24.347ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
98582025-02-21T10:09:24.377ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
98592025-02-21T10:09:24.377ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:60552
98602025-02-21T10:09:24.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:60552 req_id = b1d7eb6e-1cc9-459d-980d-9d553e74e72f roles = RoleSet { roles: {} } uri = /metrics/producers
98612025-02-21T10:09:24.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:60552 req_id = b1d7eb6e-1cc9-459d-980d-9d553e74e72f resource = Database result = Ok(()) uri = /metrics/producers
98622025-02-21T10:09:24.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 60cf4065-f42c-4b35-9be9-4296e9195d51 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98632025-02-21T10:09:24.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 60cf4065-f42c-4b35-9be9-4296e9195d51 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98642025-02-21T10:09:24.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 60cf4065-f42c-4b35-9be9-4296e9195d51 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98652025-02-21T10:09:24.431ZINFOnexus: assigned collector to new producer collector_id = 8d248760-b8d2-4503-94cf-92f282d79332 file = nexus/src/app/oximeter.rs:76 producer_id = 78cc7a50-acf8-416c-b0e8-3080705dc078
98662025-02-21T10:09:24.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 53765 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:60552 req_id = b1d7eb6e-1cc9-459d-980d-9d553e74e72f response_code = 201 uri = /metrics/producers
98672025-02-21T10:09:24.431ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b1d7eb6e-1cc9-459d-980d-9d553e74e72f", "content-length": "41", "date": "Fri, 21 Feb 2025 10:09:24 GMT"} })
98682025-02-21T10:09:24.434ZDEBGnexus (producer-registration-task): registered with nexus successfully
98692025-02-21T10:09:24.434ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
98702025-02-21T10:09:25.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bca0d5a7-f240-4569-a25c-e18b4442ee94 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98712025-02-21T10:09:25.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bca0d5a7-f240-4569-a25c-e18b4442ee94 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98722025-02-21T10:09:25.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bca0d5a7-f240-4569-a25c-e18b4442ee94 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98732025-02-21T10:09:26.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 826ea0ba-c2af-483b-986b-7bacbdf55285 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98742025-02-21T10:09:26.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 826ea0ba-c2af-483b-986b-7bacbdf55285 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98752025-02-21T10:09:26.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 826ea0ba-c2af-483b-986b-7bacbdf55285 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98762025-02-21T10:09:26.543ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 617 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = ad4a1833-ab5f-40b1-bfb7-5f071449e8c6 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
98772025-02-21T10:09:27.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 61b5f455-34a4-4ec0-b83a-fc9ced3b7447 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98782025-02-21T10:09:27.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 61b5f455-34a4-4ec0-b83a-fc9ced3b7447 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98792025-02-21T10:09:27.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2629 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 61b5f455-34a4-4ec0-b83a-fc9ced3b7447 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98802025-02-21T10:09:28.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 291f172c-9a54-4427-8a2e-69a8c6168b5a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98812025-02-21T10:09:28.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 291f172c-9a54-4427-8a2e-69a8c6168b5a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98822025-02-21T10:09:28.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 291f172c-9a54-4427-8a2e-69a8c6168b5a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98832025-02-21T10:09:29.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a03a30f6-10b1-42cd-843b-869f25e776fa roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98842025-02-21T10:09:29.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a03a30f6-10b1-42cd-843b-869f25e776fa resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98852025-02-21T10:09:29.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2865 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = a03a30f6-10b1-42cd-843b-869f25e776fa response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98862025-02-21T10:09:30.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb484265-09bf-4df9-990f-ab40f38bb3d9 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98872025-02-21T10:09:30.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb484265-09bf-4df9-990f-ab40f38bb3d9 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98882025-02-21T10:09:30.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bb484265-09bf-4df9-990f-ab40f38bb3d9 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98892025-02-21T10:09:31.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03b5984d-3f60-47e3-bc04-d02a1ba65ed2 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98902025-02-21T10:09:31.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03b5984d-3f60-47e3-bc04-d02a1ba65ed2 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98912025-02-21T10:09:31.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 03b5984d-3f60-47e3-bc04-d02a1ba65ed2 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98922025-02-21T10:09:32.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 47fe3bce-0ad6-4d67-8def-64e8460f89e6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98932025-02-21T10:09:32.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 47fe3bce-0ad6-4d67-8def-64e8460f89e6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98942025-02-21T10:09:32.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2192 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 47fe3bce-0ad6-4d67-8def-64e8460f89e6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
98952025-02-21T10:09:33.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
98962025-02-21T10:09:33.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98972025-02-21T10:09:33.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
98982025-02-21T10:09:33.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98992025-02-21T10:09:33.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99002025-02-21T10:09:33.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99012025-02-21T10:09:33.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99022025-02-21T10:09:33.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99032025-02-21T10:09:33.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99042025-02-21T10:09:33.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.855483ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99052025-02-21T10:09:33.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99062025-02-21T10:09:33.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99072025-02-21T10:09:33.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99082025-02-21T10:09:33.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99092025-02-21T10:09:33.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99102025-02-21T10:09:33.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99112025-02-21T10:09:33.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
99122025-02-21T10:09:33.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99132025-02-21T10:09:33.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99142025-02-21T10:09:33.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 136fa94d-e573-4472-b535-a84f83ae415b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99152025-02-21T10:09:33.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 136fa94d-e573-4472-b535-a84f83ae415b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99162025-02-21T10:09:33.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 136fa94d-e573-4472-b535-a84f83ae415b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99172025-02-21T10:09:33.581ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
99182025-02-21T10:09:33.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.232694ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
99192025-02-21T10:09:34.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 018d9440-e24e-40f4-acd7-98d81da1c403 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99202025-02-21T10:09:34.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 018d9440-e24e-40f4-acd7-98d81da1c403 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99212025-02-21T10:09:34.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 018d9440-e24e-40f4-acd7-98d81da1c403 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99222025-02-21T10:09:35.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 286f8bb7-ce82-4f99-9b25-59f3bd27f06e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99232025-02-21T10:09:35.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 286f8bb7-ce82-4f99-9b25-59f3bd27f06e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99242025-02-21T10:09:35.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2632 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 286f8bb7-ce82-4f99-9b25-59f3bd27f06e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99252025-02-21T10:09:36.542ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 613 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 7be06705-df38-4b9e-a774-e57801fab310 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
99262025-02-21T10:09:36.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f1a7d7f0-a6d9-4bd9-bc5b-89187d10f846 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99272025-02-21T10:09:36.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f1a7d7f0-a6d9-4bd9-bc5b-89187d10f846 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99282025-02-21T10:09:36.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2026 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f1a7d7f0-a6d9-4bd9-bc5b-89187d10f846 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99292025-02-21T10:09:37.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f6c716ba-0f84-434c-a4ff-3cea98b4a1ec roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99302025-02-21T10:09:37.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f6c716ba-0f84-434c-a4ff-3cea98b4a1ec resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99312025-02-21T10:09:37.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f6c716ba-0f84-434c-a4ff-3cea98b4a1ec response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99322025-02-21T10:09:38.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = acdadf50-c1c3-4332-8fd4-5e19ce44b865 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99332025-02-21T10:09:38.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = acdadf50-c1c3-4332-8fd4-5e19ce44b865 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99342025-02-21T10:09:38.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = acdadf50-c1c3-4332-8fd4-5e19ce44b865 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99352025-02-21T10:09:39.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 003ea61c-7362-4f67-b2cc-b3f02197461e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
99362025-02-21T10:09:39.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 003ea61c-7362-4f67-b2cc-b3f02197461e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
99372025-02-21T10:09:39.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 003ea61c-7362-4f67-b2cc-b3f02197461e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
99382025-02-21T10:09:39.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 80a58104-9ab7-4d2f-8cbb-be6cd2fec448 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99392025-02-21T10:09:39.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 80a58104-9ab7-4d2f-8cbb-be6cd2fec448 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99402025-02-21T10:09:39.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 80a58104-9ab7-4d2f-8cbb-be6cd2fec448 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99412025-02-21T10:09:40.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eba137c5-bb0a-4ae9-92cc-3bf202fdc7ef roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99422025-02-21T10:09:40.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eba137c5-bb0a-4ae9-92cc-3bf202fdc7ef resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99432025-02-21T10:09:40.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = eba137c5-bb0a-4ae9-92cc-3bf202fdc7ef response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99442025-02-21T10:09:41.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e697a418-ea5e-49dd-86e7-3950afae6c8a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99452025-02-21T10:09:41.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e697a418-ea5e-49dd-86e7-3950afae6c8a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99462025-02-21T10:09:41.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e697a418-ea5e-49dd-86e7-3950afae6c8a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99472025-02-21T10:09:42.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bbc8e881-6fc3-4dd1-9f17-a7f9d356a7c6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99482025-02-21T10:09:42.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bbc8e881-6fc3-4dd1-9f17-a7f9d356a7c6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99492025-02-21T10:09:42.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = bbc8e881-6fc3-4dd1-9f17-a7f9d356a7c6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99502025-02-21T10:09:43.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
99512025-02-21T10:09:43.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
99522025-02-21T10:09:43.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99532025-02-21T10:09:43.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99542025-02-21T10:09:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99552025-02-21T10:09:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99562025-02-21T10:09:43.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99572025-02-21T10:09:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99582025-02-21T10:09:43.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99592025-02-21T10:09:43.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.282243ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99602025-02-21T10:09:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99612025-02-21T10:09:43.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99622025-02-21T10:09:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99632025-02-21T10:09:43.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99642025-02-21T10:09:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99652025-02-21T10:09:43.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99662025-02-21T10:09:43.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
99672025-02-21T10:09:43.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99682025-02-21T10:09:43.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99692025-02-21T10:09:43.576ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
99702025-02-21T10:09:43.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.346937ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
99712025-02-21T10:09:43.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 93f10cca-aa68-40a4-861f-4576f8482f3f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99722025-02-21T10:09:43.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 93f10cca-aa68-40a4-861f-4576f8482f3f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99732025-02-21T10:09:43.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 93f10cca-aa68-40a4-861f-4576f8482f3f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99742025-02-21T10:09:44.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e6d3804e-dc44-45cd-97b7-a6166ae335dc roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99752025-02-21T10:09:44.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e6d3804e-dc44-45cd-97b7-a6166ae335dc resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99762025-02-21T10:09:44.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e6d3804e-dc44-45cd-97b7-a6166ae335dc response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99772025-02-21T10:09:45.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e1d89346-62e9-4254-b798-111fc9889c5f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99782025-02-21T10:09:45.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e1d89346-62e9-4254-b798-111fc9889c5f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99792025-02-21T10:09:45.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e1d89346-62e9-4254-b798-111fc9889c5f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99802025-02-21T10:09:46.542ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 604 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 73be436c-b2a9-4adc-a486-bd1543337cc4 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
99812025-02-21T10:09:46.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 44152b66-b9bf-4758-ae67-46f8495371f7 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99822025-02-21T10:09:46.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 44152b66-b9bf-4758-ae67-46f8495371f7 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99832025-02-21T10:09:46.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3083 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 44152b66-b9bf-4758-ae67-46f8495371f7 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99842025-02-21T10:09:47.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d5476253-aaf0-4c8f-9cd0-3ed123fa5399 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99852025-02-21T10:09:47.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d5476253-aaf0-4c8f-9cd0-3ed123fa5399 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99862025-02-21T10:09:47.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d5476253-aaf0-4c8f-9cd0-3ed123fa5399 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99872025-02-21T10:09:48.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 48d925c3-101a-45a0-a664-101572d7bf69 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99882025-02-21T10:09:48.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 48d925c3-101a-45a0-a664-101572d7bf69 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99892025-02-21T10:09:48.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2746 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 48d925c3-101a-45a0-a664-101572d7bf69 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99902025-02-21T10:09:49.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = acba7e9d-fa6a-4c13-b52d-9bd77e8b8a4b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99912025-02-21T10:09:49.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = acba7e9d-fa6a-4c13-b52d-9bd77e8b8a4b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99922025-02-21T10:09:49.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = acba7e9d-fa6a-4c13-b52d-9bd77e8b8a4b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99932025-02-21T10:09:50.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 95674d99-e2f4-477f-b5dc-0194dbcadba3 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99942025-02-21T10:09:50.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 95674d99-e2f4-477f-b5dc-0194dbcadba3 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99952025-02-21T10:09:50.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2903 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 95674d99-e2f4-477f-b5dc-0194dbcadba3 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
99962025-02-21T10:09:51.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = f1fb45e4-86f4-4242-a566-d29d43a9844c roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
99972025-02-21T10:09:51.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = f1fb45e4-86f4-4242-a566-d29d43a9844c resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
99982025-02-21T10:09:51.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3684 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = f1fb45e4-86f4-4242-a566-d29d43a9844c response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?sort_by=id_ascending
99992025-02-21T10:09:51.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 8d192a8a-e962-4632-b161-7860b976c692 roles = RoleSet { roles: {} } uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
100002025-02-21T10:09:51.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 8d192a8a-e962-4632-b161-7860b976c692 resource = Database result = Ok(()) uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
100012025-02-21T10:09:51.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2746 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39900 req_id = 8d192a8a-e962-4632-b161-7860b976c692 response_code = 200 uri = /metrics/collectors/8d248760-b8d2-4503-94cf-92f282d79332/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTI3MzMwYS0zMDJlLTRmMzctODUxMy0wZWUxODQwMTU5YWYifX0%3D
100022025-02-21T10:09:51.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 83a1ec05-d857-48f7-8b00-8556b233e6ee roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
100032025-02-21T10:09:51.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 83a1ec05-d857-48f7-8b00-8556b233e6ee resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
100042025-02-21T10:09:51.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 83a1ec05-d857-48f7-8b00-8556b233e6ee response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
100052025-02-21T10:09:53.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f98e29d1-77ab-4a38-a140-2d222efc3cfe roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
100062025-02-21T10:09:53.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f98e29d1-77ab-4a38-a140-2d222efc3cfe resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
100072025-02-21T10:09:53.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = f98e29d1-77ab-4a38-a140-2d222efc3cfe response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
100082025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
100092025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
100102025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
100112025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100122025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
100132025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
100142025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100152025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100162025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100172025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
100182025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100192025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
100202025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100212025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
100222025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100232025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
100242025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
100252025-02-21T10:09:53.557ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100262025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100272025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100282025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
100292025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100302025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
100312025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100322025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
100332025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100342025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
100352025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
100362025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100372025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100382025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
100392025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100402025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
100412025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100422025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
100432025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100442025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
100452025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
100462025-02-21T10:09:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100472025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
100482025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100492025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100502025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100512025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100522025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100532025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100542025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100552025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100562025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100572025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100582025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100592025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100602025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100612025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100622025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100632025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100642025-02-21T10:09:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100652025-02-21T10:09:53.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100662025-02-21T10:09:53.561ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.656578ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100672025-02-21T10:09:53.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100682025-02-21T10:09:53.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100692025-02-21T10:09:53.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100702025-02-21T10:09:53.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100712025-02-21T10:09:53.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
100722025-02-21T10:09:53.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100732025-02-21T10:09:53.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100742025-02-21T10:09:53.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100752025-02-21T10:09:53.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100762025-02-21T10:09:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100772025-02-21T10:09:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
100782025-02-21T10:09:53.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100792025-02-21T10:09:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100802025-02-21T10:09:53.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100812025-02-21T10:09:53.567ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100822025-02-21T10:09:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
100832025-02-21T10:09:53.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100842025-02-21T10:09:53.567ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1791, tv_nsec: 866611688 } })
100852025-02-21T10:09:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100862025-02-21T10:09:53.568ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1791, tv_nsec: 866903325 } })
100872025-02-21T10:09:53.568ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
100882025-02-21T10:09:53.568ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100892025-02-21T10:09:53.568ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
100902025-02-21T10:09:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100912025-02-21T10:09:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
100922025-02-21T10:09:53.569ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100932025-02-21T10:09:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100942025-02-21T10:09:53.569ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100952025-02-21T10:09:53.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100962025-02-21T10:09:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100972025-02-21T10:09:53.571ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100982025-02-21T10:09:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100992025-02-21T10:09:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101002025-02-21T10:09:53.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101012025-02-21T10:09:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101022025-02-21T10:09:53.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101032025-02-21T10:09:53.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101042025-02-21T10:09:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101052025-02-21T10:09:53.577ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9f7d1cf8-48de-4890-ab3d-e135f2248edc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1791, tv_nsec: 876416975 } })
101062025-02-21T10:09:53.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101072025-02-21T10:09:53.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101082025-02-21T10:09:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101092025-02-21T10:09:53.577ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
101102025-02-21T10:09:53.578ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101112025-02-21T10:09:53.578ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.577866ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101122025-02-21T10:09:53.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101132025-02-21T10:09:53.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101142025-02-21T10:09:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101152025-02-21T10:09:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101162025-02-21T10:09:53.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101172025-02-21T10:09:53.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101182025-02-21T10:09:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101192025-02-21T10:09:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101202025-02-21T10:09:53.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101212025-02-21T10:09:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101222025-02-21T10:09:53.601ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 43.901039ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
101232025-02-21T10:09:53.606ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101242025-02-21T10:09:53.606ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101252025-02-21T10:09:53.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101262025-02-21T10:09:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101272025-02-21T10:09:53.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.111547ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
101282025-02-21T10:09:53.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101292025-02-21T10:09:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101302025-02-21T10:09:53.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101312025-02-21T10:09:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101322025-02-21T10:09:53.614ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101332025-02-21T10:09:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101342025-02-21T10:09:53.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101352025-02-21T10:09:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101362025-02-21T10:09:53.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.923958ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
101372025-02-21T10:09:53.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.914796ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101382025-02-21T10:09:53.618ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101392025-02-21T10:09:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101402025-02-21T10:09:53.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101412025-02-21T10:09:53.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
101422025-02-21T10:09:53.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101432025-02-21T10:09:53.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101442025-02-21T10:09:53.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101452025-02-21T10:09:53.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101462025-02-21T10:09:53.671ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
101472025-02-21T10:09:53.671ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101482025-02-21T10:09:53.671ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
101492025-02-21T10:09:53.671ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101502025-02-21T10:09:53.671ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd2ce7c8-5ece-469e-9834-942418612595", "content-length": "26", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
101512025-02-21T10:09:53.671ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101522025-02-21T10:09:53.671ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce3bc1cd-b2ae-423a-b025-eca49368090b", "content-length": "26", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
101532025-02-21T10:09:53.671ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101542025-02-21T10:09:53.673ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101552025-02-21T10:09:53.674ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101562025-02-21T10:09:53.689ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd zone_address = fd00:1122:3344:101::2
101572025-02-21T10:09:53.689ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101582025-02-21T10:09:53.689ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16cd5820-e155-44a4-acef-6e77924f20ad", "content-length": "26", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
101592025-02-21T10:09:53.689ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101602025-02-21T10:09:53.691ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
101612025-02-21T10:09:53.713ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
101622025-02-21T10:09:53.713ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
101632025-02-21T10:09:53.713ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "78489bb6-4d43-4ecb-b7cb-aa8bcaa3d087", "content-length": "372", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
101642025-02-21T10:09:53.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101652025-02-21T10:09:53.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101662025-02-21T10:09:53.716ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101672025-02-21T10:09:53.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101682025-02-21T10:09:53.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101692025-02-21T10:09:53.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
101702025-02-21T10:09:53.718ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101712025-02-21T10:09:53.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101722025-02-21T10:09:53.721ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
101732025-02-21T10:09:53.721ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 163.502627ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
101742025-02-21T10:09:53.732ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
101752025-02-21T10:09:53.732ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 174.754879ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
101762025-02-21T10:09:53.758ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 200.800996ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
101772025-02-21T10:09:53.763ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101782025-02-21T10:09:53.763ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101792025-02-21T10:09:53.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101802025-02-21T10:09:53.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101812025-02-21T10:09:53.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101822025-02-21T10:09:53.764ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101832025-02-21T10:09:53.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101842025-02-21T10:09:53.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101852025-02-21T10:09:53.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 207.446487ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101862025-02-21T10:09:53.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101872025-02-21T10:09:53.768ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 211.109476ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101882025-02-21T10:09:53.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101892025-02-21T10:09:53.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101902025-02-21T10:09:53.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101912025-02-21T10:09:53.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101922025-02-21T10:09:53.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9f7d1cf8-48de-4890-ab3d-e135f2248edc, lookup_type: ById(9f7d1cf8-48de-4890-ab3d-e135f2248edc) } result = Ok(())
101932025-02-21T10:09:53.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101942025-02-21T10:09:53.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101952025-02-21T10:09:53.773ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 216.174949ms iteration = 24 status = 0
101962025-02-21T10:09:53.779ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
101972025-02-21T10:09:53.779ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4164a5dc-9650-4a66-9cf0-fe0bcf583374", "content-length": "2", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
101982025-02-21T10:09:53.780ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
101992025-02-21T10:09:53.780ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102002025-02-21T10:09:53.780ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c2894594-dccb-4c25-8824-1e3a0c92b408", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
102012025-02-21T10:09:53.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102022025-02-21T10:09:53.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102032025-02-21T10:09:53.781ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102042025-02-21T10:09:53.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102052025-02-21T10:09:53.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102062025-02-21T10:09:53.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102072025-02-21T10:09:53.783ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 225.327359ms iteration = 24 status = null
102082025-02-21T10:09:53.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102092025-02-21T10:09:53.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102102025-02-21T10:09:53.788ZINFOnexus (BackgroundTasks): VPC route manager sled 9f7d1cf8-48de-4890-ab3d-e135f2248edc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102112025-02-21T10:09:53.788ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102122025-02-21T10:09:53.789ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "629b7344-8212-4cdc-bf6a-609afafa6e5b", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
102132025-02-21T10:09:53.791ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 233.281001ms iteration = 25 status = {}
102142025-02-21T10:09:53.793ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 236.15038ms iteration = 24 status = {}
102152025-02-21T10:09:53.797ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102162025-02-21T10:09:53.797ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102172025-02-21T10:09:53.797ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 239.45114ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102182025-02-21T10:09:53.819ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 261.954763ms iteration = 27 status = {"physical_disks_added":0}
102192025-02-21T10:09:53.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102202025-02-21T10:09:53.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102212025-02-21T10:09:53.849ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: df1c3459-0bea-4d05-bd8d-77992fa9dd19, rack_id: 2c34edac-64c1-4af0-bbbb-7d62685084cd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(370244f0-d4be-476f-968b-93d7bfbc6362) } rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
102222025-02-21T10:09:53.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102232025-02-21T10:09:53.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102242025-02-21T10:09:53.861ZDEBGnexus (BackgroundTasks): client request SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102252025-02-21T10:09:53.862ZDEBGnexus (BackgroundTasks): client response SledAgent = 9f7d1cf8-48de-4890-ab3d-e135f2248edc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "91286ac9-76cb-4aab-ac15-e8b91255246f", "content-length": "691", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
102262025-02-21T10:09:53.862ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
102272025-02-21T10:09:53.862ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
102282025-02-21T10:09:53.862ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
102292025-02-21T10:09:53.863ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 305.206817ms iteration = 25 status = {}
102302025-02-21T10:09:53.871ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
102312025-02-21T10:09:53.871ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c80fbd7e-1e9b-4442-9934-9ed7fe3f3e79", "content-length": "134", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
102322025-02-21T10:09:53.871ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
102332025-02-21T10:09:53.871ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 370244f0-d4be-476f-968b-93d7bfbc6362
102342025-02-21T10:09:53.871ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
102352025-02-21T10:09:53.871ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
102362025-02-21T10:09:53.871ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102372025-02-21T10:09:53.871ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102382025-02-21T10:09:53.871ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102392025-02-21T10:09:53.871ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102402025-02-21T10:09:53.872ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102412025-02-21T10:09:53.872ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102422025-02-21T10:09:53.872ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd
102432025-02-21T10:09:53.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102442025-02-21T10:09:53.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102452025-02-21T10:09:53.874ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
102462025-02-21T10:09:53.874ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa3a8a32-b5a2-4f93-a50e-a55d14b5478a", "content-length": "2", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
102472025-02-21T10:09:53.874ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
102482025-02-21T10:09:53.874ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b861673-c110-4947-8859-b9f553d9fb1c", "content-length": "52", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
102492025-02-21T10:09:53.874ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch_location = Switch0
102502025-02-21T10:09:53.874ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
102512025-02-21T10:09:53.973ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5cfd0d08-6821-411f-a7ff-424d8d97ff4a", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
102522025-02-21T10:09:53.973ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd switch = Switch0
102532025-02-21T10:09:53.973ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
102542025-02-21T10:09:53.973ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2c34edac-64c1-4af0-bbbb-7d62685084cd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b61f494e-2c3a-4a78-855e-d82f87b285c3", "content-length": "682", "date": "Fri, 21 Feb 2025 10:09:53 GMT"} })
102552025-02-21T10:09:53.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102562025-02-21T10:09:53.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102572025-02-21T10:09:53.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102582025-02-21T10:09:53.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102592025-02-21T10:09:53.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102602025-02-21T10:09:53.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102612025-02-21T10:09:53.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102622025-02-21T10:09:53.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102632025-02-21T10:09:53.990ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 432.741136ms iteration = 24 status = {}
102642025-02-21T10:09:54.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 86901610-af69-45a8-a3e2-621d255fa414 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102652025-02-21T10:09:54.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 86901610-af69-45a8-a3e2-621d255fa414 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102662025-02-21T10:09:54.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2632 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 86901610-af69-45a8-a3e2-621d255fa414 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102672025-02-21T10:09:55.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ad53aaeb-999c-478f-ab7f-ca6f7e37260b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102682025-02-21T10:09:55.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ad53aaeb-999c-478f-ab7f-ca6f7e37260b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102692025-02-21T10:09:55.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2645 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = ad53aaeb-999c-478f-ab7f-ca6f7e37260b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102702025-02-21T10:09:56.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cadb0d32-ab14-4002-85b6-5b30a3307b16 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102712025-02-21T10:09:56.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cadb0d32-ab14-4002-85b6-5b30a3307b16 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102722025-02-21T10:09:56.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2593 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = cadb0d32-ab14-4002-85b6-5b30a3307b16 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102732025-02-21T10:09:56.542ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 537 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = 99873f27-e683-4c87-85b4-ad65f8417d3b response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
102742025-02-21T10:09:57.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b08812ed-668e-4def-be4e-1103e12c883a roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102752025-02-21T10:09:57.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b08812ed-668e-4def-be4e-1103e12c883a resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102762025-02-21T10:09:57.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3032 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b08812ed-668e-4def-be4e-1103e12c883a response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102772025-02-21T10:09:58.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c237a713-8b3b-4748-816c-1b9cd3875d88 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102782025-02-21T10:09:58.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c237a713-8b3b-4748-816c-1b9cd3875d88 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102792025-02-21T10:09:58.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2225 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = c237a713-8b3b-4748-816c-1b9cd3875d88 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102802025-02-21T10:09:59.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1d23332c-2b06-4a87-be65-6fe663dd2d6f roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102812025-02-21T10:09:59.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1d23332c-2b06-4a87-be65-6fe663dd2d6f resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102822025-02-21T10:09:59.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 1d23332c-2b06-4a87-be65-6fe663dd2d6f response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102832025-02-21T10:10:00.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 168f7230-f7e9-49bf-8f49-82c341af0998 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102842025-02-21T10:10:00.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 168f7230-f7e9-49bf-8f49-82c341af0998 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102852025-02-21T10:10:00.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 168f7230-f7e9-49bf-8f49-82c341af0998 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102862025-02-21T10:10:01.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b78f52dd-1f28-496b-92db-bae64b6fec97 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102872025-02-21T10:10:01.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b78f52dd-1f28-496b-92db-bae64b6fec97 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102882025-02-21T10:10:01.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = b78f52dd-1f28-496b-92db-bae64b6fec97 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102892025-02-21T10:10:02.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5cb3a91a-9a90-4edd-bd52-ed0ac3e54f84 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102902025-02-21T10:10:02.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5cb3a91a-9a90-4edd-bd52-ed0ac3e54f84 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102912025-02-21T10:10:02.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 5cb3a91a-9a90-4edd-bd52-ed0ac3e54f84 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102922025-02-21T10:10:03.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 183dbd59-74af-47d6-b9e8-3fcc6e0c1783 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102932025-02-21T10:10:03.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 183dbd59-74af-47d6-b9e8-3fcc6e0c1783 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102942025-02-21T10:10:03.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 183dbd59-74af-47d6-b9e8-3fcc6e0c1783 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
102952025-02-21T10:10:03.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
102962025-02-21T10:10:03.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
102972025-02-21T10:10:03.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102982025-02-21T10:10:03.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102992025-02-21T10:10:03.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103002025-02-21T10:10:03.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103012025-02-21T10:10:03.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103022025-02-21T10:10:03.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103032025-02-21T10:10:03.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103042025-02-21T10:10:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103052025-02-21T10:10:03.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103062025-02-21T10:10:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103072025-02-21T10:10:03.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.17777ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103082025-02-21T10:10:03.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103092025-02-21T10:10:03.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103102025-02-21T10:10:03.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103112025-02-21T10:10:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
103122025-02-21T10:10:03.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103132025-02-21T10:10:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103142025-02-21T10:10:03.610ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
103152025-02-21T10:10:03.610ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.842795ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
103162025-02-21T10:10:04.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30df5865-d7df-4db4-b642-43a1523da621 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103172025-02-21T10:10:04.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30df5865-d7df-4db4-b642-43a1523da621 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103182025-02-21T10:10:04.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30df5865-d7df-4db4-b642-43a1523da621 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103192025-02-21T10:10:05.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30bef2a3-a9ac-46ab-918d-00f123c5e235 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103202025-02-21T10:10:05.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30bef2a3-a9ac-46ab-918d-00f123c5e235 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103212025-02-21T10:10:05.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 30bef2a3-a9ac-46ab-918d-00f123c5e235 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103222025-02-21T10:10:06.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e74f6092-2a1b-400b-9972-9b5b684a23a6 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103232025-02-21T10:10:06.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e74f6092-2a1b-400b-9972-9b5b684a23a6 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103242025-02-21T10:10:06.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2702 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = e74f6092-2a1b-400b-9972-9b5b684a23a6 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103252025-02-21T10:10:06.542ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 527 local_addr = [fd00:1122:3344:101::a]:34242 method = GET remote_addr = [fd00:1122:3344:101::d]:45034 req_id = c7c396be-7adb-48ec-ae65-c1a283722855 response_code = 200 uri = /78cc7a50-acf8-416c-b0e8-3080705dc078
103262025-02-21T10:10:07.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d3c55763-62f7-43d5-b91e-6039842cf7fe roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103272025-02-21T10:10:07.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d3c55763-62f7-43d5-b91e-6039842cf7fe resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103282025-02-21T10:10:07.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1861 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d3c55763-62f7-43d5-b91e-6039842cf7fe response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103292025-02-21T10:10:08.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7588e6b0-baf9-45cf-9623-0f2ea9eb1244 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103302025-02-21T10:10:08.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7588e6b0-baf9-45cf-9623-0f2ea9eb1244 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103312025-02-21T10:10:08.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7588e6b0-baf9-45cf-9623-0f2ea9eb1244 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103322025-02-21T10:10:09.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 488a8389-0a28-412b-8e9d-55acfc9e36fe roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103332025-02-21T10:10:09.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 488a8389-0a28-412b-8e9d-55acfc9e36fe resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103342025-02-21T10:10:09.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 488a8389-0a28-412b-8e9d-55acfc9e36fe response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103352025-02-21T10:10:09.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 27a357f8-c141-42b1-843c-d57f83d4368e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
103362025-02-21T10:10:09.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 27a357f8-c141-42b1-843c-d57f83d4368e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
103372025-02-21T10:10:09.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3762 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:65526 req_id = 27a357f8-c141-42b1-843c-d57f83d4368e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
103382025-02-21T10:10:10.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 602b8eff-7c13-42e4-a52b-9f77ceb0ac78 roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103392025-02-21T10:10:10.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 602b8eff-7c13-42e4-a52b-9f77ceb0ac78 resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103402025-02-21T10:10:10.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 602b8eff-7c13-42e4-a52b-9f77ceb0ac78 response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103412025-02-21T10:10:11.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4c132bfd-a2ca-44ba-88a6-15cf2bf7763b roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103422025-02-21T10:10:11.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4c132bfd-a2ca-44ba-88a6-15cf2bf7763b resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103432025-02-21T10:10:11.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1915 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 4c132bfd-a2ca-44ba-88a6-15cf2bf7763b response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103442025-02-21T10:10:12.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7c842d91-c544-4a85-8f6b-9cec393b696d roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103452025-02-21T10:10:12.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7c842d91-c544-4a85-8f6b-9cec393b696d resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103462025-02-21T10:10:12.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2462 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = 7c842d91-c544-4a85-8f6b-9cec393b696d response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103472025-02-21T10:10:13.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d99db709-4069-4dfb-b32d-bcaf0a158b5e roles = RoleSet { roles: {} } uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103482025-02-21T10:10:13.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d99db709-4069-4dfb-b32d-bcaf0a158b5e resource = Database result = Ok(()) uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103492025-02-21T10:10:13.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52053 req_id = d99db709-4069-4dfb-b32d-bcaf0a158b5e response_code = 200 uri = /probes/9f7d1cf8-48de-4890-ab3d-e135f2248edc
103502025-02-21T10:10:13.556ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
103512025-02-21T10:10:13.556ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
103522025-02-21T10:10:13.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103532025-02-21T10:10:13.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103542025-02-21T10:10:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103552025-02-21T10:10:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103562025-02-21T10:10:13.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103572025-02-21T10:10:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103582025-02-21T10:10:13.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103592025-02-21T10:10:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103602025-02-21T10:10:13.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103612025-02-21T10:10:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103622025-02-21T10:10:13.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103632025-02-21T10:10:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3ad3cd0-99f3-4e99-9e08-b156d4c97041, lookup_type: ById(f3ad3cd0-99f3-4e99-9e08-b156d4c97041) } result = Ok(())
103642025-02-21T10:10:13.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103652025-02-21T10:10:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103662025-02-21T10:10:13.579ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 original_time_created = 2025-02-21 09:58:18.314433 UTC target_id = f3ad3cd0-99f3-4e99-9e08-b156d4c97041 time_created = 2025-02-21 09:58:18.314433 UTC
103672025-02-21T10:10:13.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.127538ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3ad3cd0-99f3-4e99-9e08-b156d4c97041","time_created":"2025-02-21T09:58:18.314433Z"}
103682025-02-21T10:10:13.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103692025-02-21T10:10:13.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103702025-02-21T10:10:13.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.592762ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}