Max level shown:
12025-01-08T15:30:03.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 843474a4-98cc-4cb3-b19b-a98f7f2a41d2 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22025-01-08T15:30:03.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 843474a4-98cc-4cb3-b19b-a98f7f2a41d2 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
32025-01-08T15:30:03.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 843474a4-98cc-4cb3-b19b-a98f7f2a41d2 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
42025-01-08T15:30:04.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fb536de5-294a-4e0d-b9eb-50d9070639c7 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
52025-01-08T15:30:04.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fb536de5-294a-4e0d-b9eb-50d9070639c7 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
62025-01-08T15:30:04.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fb536de5-294a-4e0d-b9eb-50d9070639c7 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
72025-01-08T15:30:05.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f995182c-d2c0-401c-b6b6-34ef9e99cb87 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
82025-01-08T15:30:05.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f995182c-d2c0-401c-b6b6-34ef9e99cb87 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
92025-01-08T15:30:05.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f995182c-d2c0-401c-b6b6-34ef9e99cb87 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
102025-01-08T15:30:06.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3e6f7197-87ff-4700-914a-71a432401019 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
112025-01-08T15:30:06.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3e6f7197-87ff-4700-914a-71a432401019 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
122025-01-08T15:30:06.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3e6f7197-87ff-4700-914a-71a432401019 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
132025-01-08T15:30:06.786ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1499 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = fdbf2b27-a9bd-4129-bc1a-61089a241427 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
142025-01-08T15:30:07.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 10155616-7169-4a0a-b210-c1a955247423 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
152025-01-08T15:30:07.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 10155616-7169-4a0a-b210-c1a955247423 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
162025-01-08T15:30:07.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 10155616-7169-4a0a-b210-c1a955247423 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
172025-01-08T15:30:08.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 61d71435-c272-46dd-a5aa-b11f762939f7 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
182025-01-08T15:30:08.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 61d71435-c272-46dd-a5aa-b11f762939f7 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
192025-01-08T15:30:08.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 61d71435-c272-46dd-a5aa-b11f762939f7 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
202025-01-08T15:30:08.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
212025-01-08T15:30:08.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
222025-01-08T15:30:08.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
232025-01-08T15:30:08.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
242025-01-08T15:30:08.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
252025-01-08T15:30:08.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
262025-01-08T15:30:08.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
272025-01-08T15:30:08.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
282025-01-08T15:30:08.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
292025-01-08T15:30:08.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
302025-01-08T15:30:08.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
312025-01-08T15:30:08.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
322025-01-08T15:30:08.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
332025-01-08T15:30:08.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
342025-01-08T15:30:08.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
352025-01-08T15:30:08.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
362025-01-08T15:30:08.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
372025-01-08T15:30:08.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.833795ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
382025-01-08T15:30:08.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
392025-01-08T15:30:08.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
402025-01-08T15:30:08.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.853518ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
412025-01-08T15:30:09.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3c0e478a-e9a8-4bac-bb7d-147151b0943b roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
422025-01-08T15:30:09.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3c0e478a-e9a8-4bac-bb7d-147151b0943b resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
432025-01-08T15:30:09.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3c0e478a-e9a8-4bac-bb7d-147151b0943b response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
442025-01-08T15:30:10.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7e9d1efa-2618-4f92-8c31-9c1778ae7af9 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
452025-01-08T15:30:10.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7e9d1efa-2618-4f92-8c31-9c1778ae7af9 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
462025-01-08T15:30:10.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7e9d1efa-2618-4f92-8c31-9c1778ae7af9 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
472025-01-08T15:30:11.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 93170ade-3b86-4a17-aa59-e621f516e339 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
482025-01-08T15:30:11.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 93170ade-3b86-4a17-aa59-e621f516e339 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
492025-01-08T15:30:11.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 93170ade-3b86-4a17-aa59-e621f516e339 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
502025-01-08T15:30:12.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1896a253-60be-4e7d-a6b1-081e64ba054a roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
512025-01-08T15:30:12.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1896a253-60be-4e7d-a6b1-081e64ba054a resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
522025-01-08T15:30:12.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1896a253-60be-4e7d-a6b1-081e64ba054a response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
532025-01-08T15:30:13.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1744db68-4a9c-4c6a-b44f-e4914c730ecd roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
542025-01-08T15:30:13.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1744db68-4a9c-4c6a-b44f-e4914c730ecd resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
552025-01-08T15:30:13.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1744db68-4a9c-4c6a-b44f-e4914c730ecd response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
562025-01-08T15:30:14.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 37c2a671-5dac-409c-a60e-dd60a043f4c4 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
572025-01-08T15:30:14.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 37c2a671-5dac-409c-a60e-dd60a043f4c4 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
582025-01-08T15:30:14.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 37c2a671-5dac-409c-a60e-dd60a043f4c4 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
592025-01-08T15:30:15.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8cebff65-a50b-4bf2-b4a7-943d7ca01743 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
602025-01-08T15:30:15.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8cebff65-a50b-4bf2-b4a7-943d7ca01743 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
612025-01-08T15:30:15.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8cebff65-a50b-4bf2-b4a7-943d7ca01743 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
622025-01-08T15:30:16.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a0e30b31-0aef-432e-97da-59989f0abb0a roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
632025-01-08T15:30:16.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a0e30b31-0aef-432e-97da-59989f0abb0a resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
642025-01-08T15:30:16.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a0e30b31-0aef-432e-97da-59989f0abb0a response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
652025-01-08T15:30:16.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1305 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = 90768c3b-77f3-4472-b2c7-bbf84571a5c1 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
662025-01-08T15:30:17.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 759bc73b-9865-4289-8665-c9dcff2a5042 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
672025-01-08T15:30:17.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 759bc73b-9865-4289-8665-c9dcff2a5042 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
682025-01-08T15:30:17.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 759bc73b-9865-4289-8665-c9dcff2a5042 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
692025-01-08T15:30:18.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4cddf069-b538-416d-8fb3-ca6a969b75d7 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
702025-01-08T15:30:18.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4cddf069-b538-416d-8fb3-ca6a969b75d7 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
712025-01-08T15:30:18.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4cddf069-b538-416d-8fb3-ca6a969b75d7 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
722025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
732025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
742025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
752025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
762025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
772025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
782025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
792025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
802025-01-08T15:30:18.605ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
812025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
822025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
832025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
842025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
852025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
862025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
872025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
882025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
892025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
902025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
912025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
922025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
932025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
942025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
952025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
962025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
972025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
982025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
992025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1002025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1012025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1022025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1032025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1042025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1052025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1062025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1072025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1082025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1092025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1102025-01-08T15:30:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1112025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
1122025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
1132025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1142025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1152025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
1162025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
1172025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1182025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1192025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1202025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1212025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1222025-01-08T15:30:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1232025-01-08T15:30:18.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1242025-01-08T15:30:18.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.661098ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1252025-01-08T15:30:18.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1262025-01-08T15:30:18.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1272025-01-08T15:30:18.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1282025-01-08T15:30:18.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1292025-01-08T15:30:18.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1302025-01-08T15:30:18.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1312025-01-08T15:30:18.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1322025-01-08T15:30:18.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1332025-01-08T15:30:18.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1342025-01-08T15:30:18.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1352025-01-08T15:30:18.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1362025-01-08T15:30:18.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1372025-01-08T15:30:18.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1382025-01-08T15:30:18.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1392025-01-08T15:30:18.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1402025-01-08T15:30:18.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1412025-01-08T15:30:18.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1422025-01-08T15:30:18.612ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37382, tv_nsec: 742760117 } })
1432025-01-08T15:30:18.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1442025-01-08T15:30:18.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1452025-01-08T15:30:18.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37382, tv_nsec: 743215484 } })
1462025-01-08T15:30:18.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1472025-01-08T15:30:18.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1482025-01-08T15:30:18.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1492025-01-08T15:30:18.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1502025-01-08T15:30:18.617ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1512025-01-08T15:30:18.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1522025-01-08T15:30:18.619ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37382, tv_nsec: 749750708 } })
1532025-01-08T15:30:18.620ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
1542025-01-08T15:30:18.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1552025-01-08T15:30:18.620ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1562025-01-08T15:30:18.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1572025-01-08T15:30:18.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1582025-01-08T15:30:18.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1592025-01-08T15:30:18.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1602025-01-08T15:30:18.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1612025-01-08T15:30:18.645ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1622025-01-08T15:30:18.645ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1632025-01-08T15:30:18.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1642025-01-08T15:30:18.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1652025-01-08T15:30:18.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1662025-01-08T15:30:18.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1672025-01-08T15:30:18.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1682025-01-08T15:30:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1692025-01-08T15:30:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1702025-01-08T15:30:18.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1712025-01-08T15:30:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1722025-01-08T15:30:18.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1732025-01-08T15:30:18.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.501935ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
1742025-01-08T15:30:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1752025-01-08T15:30:18.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 46.722403ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1762025-01-08T15:30:18.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1772025-01-08T15:30:18.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1782025-01-08T15:30:18.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792025-01-08T15:30:18.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1802025-01-08T15:30:18.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.55747ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
1812025-01-08T15:30:18.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1822025-01-08T15:30:18.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ba54f0e2-bde0-4da7-a58e-566dc5903c14, lookup_type: ById(ba54f0e2-bde0-4da7-a58e-566dc5903c14) } result = Ok(())
1832025-01-08T15:30:18.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1842025-01-08T15:30:18.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1852025-01-08T15:30:18.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
1862025-01-08T15:30:18.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1872025-01-08T15:30:18.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1882025-01-08T15:30:18.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1892025-01-08T15:30:18.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1902025-01-08T15:30:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1912025-01-08T15:30:18.659ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 53.903247ms iteration = 22 status = 0
1922025-01-08T15:30:18.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.898192ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1932025-01-08T15:30:18.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1942025-01-08T15:30:18.663ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1952025-01-08T15:30:18.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1962025-01-08T15:30:18.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1972025-01-08T15:30:18.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1982025-01-08T15:30:18.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1992025-01-08T15:30:18.674ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2002025-01-08T15:30:18.674ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.915757ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2012025-01-08T15:30:18.685ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
2022025-01-08T15:30:18.685ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.899281ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
2032025-01-08T15:30:18.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.771828ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2042025-01-08T15:30:18.693ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2052025-01-08T15:30:18.693ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2062025-01-08T15:30:18.693ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2072025-01-08T15:30:18.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2082025-01-08T15:30:18.694ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2092025-01-08T15:30:18.694ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2102025-01-08T15:30:18.695ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37e73e6a-539a-472b-bbba-32a6f5af0901", "content-length": "26", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2112025-01-08T15:30:18.695ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2122025-01-08T15:30:18.696ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 zone_address = fd00:1122:3344:101::2
2132025-01-08T15:30:18.696ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2142025-01-08T15:30:18.696ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ef17202-3e8d-4c1f-a83e-90612bc3dfc2", "content-length": "26", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2152025-01-08T15:30:18.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2162025-01-08T15:30:18.697ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2172025-01-08T15:30:18.698ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
2182025-01-08T15:30:18.702ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2192025-01-08T15:30:18.702ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2202025-01-08T15:30:18.703ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "462d6d9f-3a93-41c4-9654-ce9f50d35e9f", "content-length": "26", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2212025-01-08T15:30:18.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2222025-01-08T15:30:18.704ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2232025-01-08T15:30:18.716ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2242025-01-08T15:30:18.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2252025-01-08T15:30:18.733ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2262025-01-08T15:30:18.733ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2272025-01-08T15:30:18.733ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.621393ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2282025-01-08T15:30:18.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2292025-01-08T15:30:18.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2302025-01-08T15:30:18.759ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 152.825292ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2312025-01-08T15:30:18.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322025-01-08T15:30:18.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2332025-01-08T15:30:18.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2342025-01-08T15:30:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2352025-01-08T15:30:18.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2362025-01-08T15:30:18.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2372025-01-08T15:30:18.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2382025-01-08T15:30:18.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2392025-01-08T15:30:18.794ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 189.340638ms iteration = 22 status = {}
2402025-01-08T15:30:18.796ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.54281ms iteration = 26 status = {"physical_disks_added":0}
2412025-01-08T15:30:18.805ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2422025-01-08T15:30:18.805ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0ebc028-9837-4359-8e4e-83d142b680c1", "content-length": "1", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2432025-01-08T15:30:18.806ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2442025-01-08T15:30:18.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2452025-01-08T15:30:18.901ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2462025-01-08T15:30:18.901ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2472025-01-08T15:30:18.901ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddf36707-de7b-4a25-8079-86943d5c0039", "content-length": "372", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2482025-01-08T15:30:18.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2492025-01-08T15:30:18.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2502025-01-08T15:30:18.909ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 304.374386ms iteration = 22 status = null
2512025-01-08T15:30:18.950ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2522025-01-08T15:30:18.950ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2532025-01-08T15:30:18.950ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cf494ba3-467b-42cf-8558-3d731770da09", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2542025-01-08T15:30:18.950ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2552025-01-08T15:30:18.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2562025-01-08T15:30:18.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2572025-01-08T15:30:18.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2582025-01-08T15:30:18.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2592025-01-08T15:30:18.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2602025-01-08T15:30:18.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2612025-01-08T15:30:18.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2622025-01-08T15:30:18.958ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c89e6001-fd6e-44a5-b55c-f8de6aa423f5, rack_id: fa7d62e1-57d8-49cc-9dd2-a5f8873ea528, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dc3d148e-05d3-48a7-97ee-42577ccf7e15) } rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0
2632025-01-08T15:30:18.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2642025-01-08T15:30:18.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2652025-01-08T15:30:18.960ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2662025-01-08T15:30:18.960ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2672025-01-08T15:30:18.961ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8f1d62d4-fb19-45ff-bec1-bac904daa3f5", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2682025-01-08T15:30:18.962ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 357.783695ms iteration = 23 status = {}
2692025-01-08T15:30:18.968ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2702025-01-08T15:30:18.968ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "62f45f38-9199-4f9b-b517-5dc307b26434", "content-length": "134", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2712025-01-08T15:30:18.968ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2722025-01-08T15:30:18.968ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dc3d148e-05d3-48a7-97ee-42577ccf7e15
2732025-01-08T15:30:18.969ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2742025-01-08T15:30:18.969ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2752025-01-08T15:30:18.969ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2762025-01-08T15:30:18.969ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2772025-01-08T15:30:18.969ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2782025-01-08T15:30:18.969ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2792025-01-08T15:30:18.969ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2802025-01-08T15:30:18.969ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2812025-01-08T15:30:18.969ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
2822025-01-08T15:30:18.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2832025-01-08T15:30:18.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2842025-01-08T15:30:18.972ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2852025-01-08T15:30:18.972ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef2aaddc-a4f3-4562-8e34-5b59b0677a61", "content-length": "2", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2862025-01-08T15:30:18.972ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2872025-01-08T15:30:18.972ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cd7a41e-cf04-41f1-a017-781a46de3190", "content-length": "51", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2882025-01-08T15:30:18.972ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0
2892025-01-08T15:30:18.972ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2902025-01-08T15:30:19.021ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2912025-01-08T15:30:19.076ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "02ac9078-ba61-4e25-93a5-54fd3915cbfd", "date": "Wed, 08 Jan 2025 15:30:18 GMT"} })
2922025-01-08T15:30:19.076ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch = Switch0
2932025-01-08T15:30:19.076ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2942025-01-08T15:30:19.077ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "11cfbfaa-c7db-45c9-a2fb-f10da4bb2f2f", "content-length": "682", "date": "Wed, 08 Jan 2025 15:30:19 GMT"} })
2952025-01-08T15:30:19.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2962025-01-08T15:30:19.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2972025-01-08T15:30:19.077ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "204572b9-4ace-4a3b-a396-92f30a75957b", "content-length": "691", "date": "Wed, 08 Jan 2025 15:30:19 GMT"} })
2982025-01-08T15:30:19.077ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2992025-01-08T15:30:19.077ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3002025-01-08T15:30:19.077ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3012025-01-08T15:30:19.079ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 474.555607ms iteration = 22 status = {}
3022025-01-08T15:30:19.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3032025-01-08T15:30:19.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3042025-01-08T15:30:19.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3052025-01-08T15:30:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3062025-01-08T15:30:19.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3072025-01-08T15:30:19.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3082025-01-08T15:30:19.095ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 490.636219ms iteration = 22 status = {}
3092025-01-08T15:30:19.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2d7ddd77-caee-41f4-996d-59e9113de228 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3102025-01-08T15:30:19.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2d7ddd77-caee-41f4-996d-59e9113de228 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3112025-01-08T15:30:19.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2d7ddd77-caee-41f4-996d-59e9113de228 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3122025-01-08T15:30:19.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 23a4f20f-c860-49d5-aa06-fd3b79b04216 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3132025-01-08T15:30:19.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 23a4f20f-c860-49d5-aa06-fd3b79b04216 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3142025-01-08T15:30:19.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 23a4f20f-c860-49d5-aa06-fd3b79b04216 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3152025-01-08T15:30:20.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b0636844-9f63-4d68-bc2c-ec46de108443 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3162025-01-08T15:30:20.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b0636844-9f63-4d68-bc2c-ec46de108443 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3172025-01-08T15:30:20.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b0636844-9f63-4d68-bc2c-ec46de108443 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3182025-01-08T15:30:21.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1cf32dea-0320-4d3a-bad3-27131d69fb2a roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3192025-01-08T15:30:21.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1cf32dea-0320-4d3a-bad3-27131d69fb2a resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3202025-01-08T15:30:21.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1cf32dea-0320-4d3a-bad3-27131d69fb2a response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3212025-01-08T15:30:21.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 5b89150a-d9e2-4c6a-8aa4-07ab1e757b54 roles = RoleSet { roles: {} } uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?sort_by=id_ascending
3222025-01-08T15:30:21.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 5b89150a-d9e2-4c6a-8aa4-07ab1e757b54 resource = Database result = Ok(()) uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?sort_by=id_ascending
3232025-01-08T15:30:21.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 5b89150a-d9e2-4c6a-8aa4-07ab1e757b54 response_code = 200 uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?sort_by=id_ascending
3242025-01-08T15:30:21.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 32d0b6c0-0d7f-4e93-a03b-27ca416cbf3e roles = RoleSet { roles: {} } uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDIxMTVkNi04NWEzLTQwNmItYmY4Mi0zMGYzNDFkZGU4YjgifX0%3D
3252025-01-08T15:30:21.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 32d0b6c0-0d7f-4e93-a03b-27ca416cbf3e resource = Database result = Ok(()) uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDIxMTVkNi04NWEzLTQwNmItYmY4Mi0zMGYzNDFkZGU4YjgifX0%3D
3262025-01-08T15:30:21.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 32d0b6c0-0d7f-4e93-a03b-27ca416cbf3e response_code = 200 uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDIxMTVkNi04NWEzLTQwNmItYmY4Mi0zMGYzNDFkZGU4YjgifX0%3D
3272025-01-08T15:30:22.506ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
3282025-01-08T15:30:22.506ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
3292025-01-08T15:30:22.536ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3302025-01-08T15:30:22.536ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:37964
3312025-01-08T15:30:22.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:37964 req_id = 60d2ce8e-b953-4ade-bfa8-94256e09d718 roles = RoleSet { roles: {} } uri = /metrics/producers
3322025-01-08T15:30:22.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:37964 req_id = 60d2ce8e-b953-4ade-bfa8-94256e09d718 resource = Database result = Ok(()) uri = /metrics/producers
3332025-01-08T15:30:22.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 071106b1-5c25-4f1f-a0b6-96e61f76e769 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3342025-01-08T15:30:22.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 071106b1-5c25-4f1f-a0b6-96e61f76e769 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3352025-01-08T15:30:22.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 071106b1-5c25-4f1f-a0b6-96e61f76e769 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3362025-01-08T15:30:22.574ZINFOnexus: assigned collector to new producer collector_id = f71f2083-2d2b-4618-9504-0628977ed486 file = nexus/src/app/oximeter.rs:76 producer_id = 4cece465-e930-47ca-aa88-ed170e15d28a
3372025-01-08T15:30:22.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37945 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:37964 req_id = 60d2ce8e-b953-4ade-bfa8-94256e09d718 response_code = 201 uri = /metrics/producers
3382025-01-08T15:30:22.574ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "60d2ce8e-b953-4ade-bfa8-94256e09d718", "content-length": "41", "date": "Wed, 08 Jan 2025 15:30:21 GMT"} })
3392025-01-08T15:30:22.577ZDEBGnexus (producer-registration-task): registered with nexus successfully
3402025-01-08T15:30:22.577ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
3412025-01-08T15:30:23.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2086d91a-cb38-4e83-bbe8-d18dd3b3fe04 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3422025-01-08T15:30:23.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2086d91a-cb38-4e83-bbe8-d18dd3b3fe04 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3432025-01-08T15:30:23.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2086d91a-cb38-4e83-bbe8-d18dd3b3fe04 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3442025-01-08T15:30:24.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f14d2655-406a-4f99-90f9-d62924aaa0cc roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3452025-01-08T15:30:24.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f14d2655-406a-4f99-90f9-d62924aaa0cc resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3462025-01-08T15:30:24.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f14d2655-406a-4f99-90f9-d62924aaa0cc response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3472025-01-08T15:30:25.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 41ea4375-d9b2-4b3b-8e34-d45ca602de23 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3482025-01-08T15:30:25.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 41ea4375-d9b2-4b3b-8e34-d45ca602de23 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3492025-01-08T15:30:25.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 41ea4375-d9b2-4b3b-8e34-d45ca602de23 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3502025-01-08T15:30:26.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = d91bcabb-d1ec-477c-a578-2715dc675b94 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3512025-01-08T15:30:26.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = d91bcabb-d1ec-477c-a578-2715dc675b94 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3522025-01-08T15:30:26.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = d91bcabb-d1ec-477c-a578-2715dc675b94 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3532025-01-08T15:30:26.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1312 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = 24b2d23f-ccf7-464c-97ac-6678de8f0319 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
3542025-01-08T15:30:27.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = d94631be-56d0-4198-a1b2-1669e795278c roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3552025-01-08T15:30:27.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = d94631be-56d0-4198-a1b2-1669e795278c resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3562025-01-08T15:30:27.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = d94631be-56d0-4198-a1b2-1669e795278c response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3572025-01-08T15:30:28.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
3582025-01-08T15:30:28.604ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
3592025-01-08T15:30:28.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3602025-01-08T15:30:28.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3612025-01-08T15:30:28.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3622025-01-08T15:30:28.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3632025-01-08T15:30:28.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3642025-01-08T15:30:28.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3652025-01-08T15:30:28.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3662025-01-08T15:30:28.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.796034ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3672025-01-08T15:30:28.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3682025-01-08T15:30:28.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3692025-01-08T15:30:28.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3702025-01-08T15:30:28.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3712025-01-08T15:30:28.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3722025-01-08T15:30:28.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3732025-01-08T15:30:28.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
3742025-01-08T15:30:28.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3752025-01-08T15:30:28.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3762025-01-08T15:30:28.630ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
3772025-01-08T15:30:28.630ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.853952ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
3782025-01-08T15:30:28.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 017062b8-f090-4ea3-9d26-171c36ef5a75 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3792025-01-08T15:30:28.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 017062b8-f090-4ea3-9d26-171c36ef5a75 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3802025-01-08T15:30:28.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 017062b8-f090-4ea3-9d26-171c36ef5a75 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3812025-01-08T15:30:29.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 70baa64b-9f17-4f10-a68b-28f2ed19dfcd roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3822025-01-08T15:30:29.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 70baa64b-9f17-4f10-a68b-28f2ed19dfcd resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3832025-01-08T15:30:29.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 70baa64b-9f17-4f10-a68b-28f2ed19dfcd response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3842025-01-08T15:30:30.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b14431f3-6701-4744-83bf-e4d5b7646ec9 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3852025-01-08T15:30:30.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b14431f3-6701-4744-83bf-e4d5b7646ec9 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3862025-01-08T15:30:30.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b14431f3-6701-4744-83bf-e4d5b7646ec9 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3872025-01-08T15:30:31.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b01fdbad-a6a6-49c2-8405-226c865db061 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3882025-01-08T15:30:31.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b01fdbad-a6a6-49c2-8405-226c865db061 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3892025-01-08T15:30:31.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b01fdbad-a6a6-49c2-8405-226c865db061 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3902025-01-08T15:30:32.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3f5f039d-44c4-4f89-8c36-b4f960272829 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3912025-01-08T15:30:32.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3f5f039d-44c4-4f89-8c36-b4f960272829 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3922025-01-08T15:30:32.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3f5f039d-44c4-4f89-8c36-b4f960272829 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3932025-01-08T15:30:33.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4f5115cb-23a4-4d98-89c7-4499104a8eee roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3942025-01-08T15:30:33.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4f5115cb-23a4-4d98-89c7-4499104a8eee resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3952025-01-08T15:30:33.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4f5115cb-23a4-4d98-89c7-4499104a8eee response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3962025-01-08T15:30:34.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 855ec171-f5bb-4338-b362-fb1e2c9fda53 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3972025-01-08T15:30:34.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 855ec171-f5bb-4338-b362-fb1e2c9fda53 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3982025-01-08T15:30:34.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 855ec171-f5bb-4338-b362-fb1e2c9fda53 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
3992025-01-08T15:30:35.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fd9de62b-e352-40a9-b2c8-5ba651a1a48a roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4002025-01-08T15:30:35.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fd9de62b-e352-40a9-b2c8-5ba651a1a48a resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4012025-01-08T15:30:35.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fd9de62b-e352-40a9-b2c8-5ba651a1a48a response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4022025-01-08T15:30:36.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1340 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = 12a4ef4a-f2aa-481b-a80b-9df60bcd15e5 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
4032025-01-08T15:30:36.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 770893ce-e1a0-49bb-857c-ae6406ed0090 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4042025-01-08T15:30:36.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 770893ce-e1a0-49bb-857c-ae6406ed0090 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4052025-01-08T15:30:36.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 770893ce-e1a0-49bb-857c-ae6406ed0090 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4062025-01-08T15:30:37.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 688eaf1b-9541-41ff-9824-a69e39b2ef9c roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4072025-01-08T15:30:37.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 688eaf1b-9541-41ff-9824-a69e39b2ef9c resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4082025-01-08T15:30:37.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 688eaf1b-9541-41ff-9824-a69e39b2ef9c response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4092025-01-08T15:30:38.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
4102025-01-08T15:30:38.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4112025-01-08T15:30:38.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
4122025-01-08T15:30:38.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4132025-01-08T15:30:38.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4142025-01-08T15:30:38.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4152025-01-08T15:30:38.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4162025-01-08T15:30:38.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4172025-01-08T15:30:38.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4182025-01-08T15:30:38.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.202266ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4192025-01-08T15:30:38.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4202025-01-08T15:30:38.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4212025-01-08T15:30:38.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4222025-01-08T15:30:38.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4232025-01-08T15:30:38.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4242025-01-08T15:30:38.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4252025-01-08T15:30:38.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
4262025-01-08T15:30:38.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4272025-01-08T15:30:38.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4282025-01-08T15:30:38.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
4292025-01-08T15:30:38.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.116141ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
4302025-01-08T15:30:38.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3a502cff-7ad8-441e-b812-555df37a9836 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4312025-01-08T15:30:38.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3a502cff-7ad8-441e-b812-555df37a9836 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4322025-01-08T15:30:38.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3a502cff-7ad8-441e-b812-555df37a9836 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4332025-01-08T15:30:39.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b63411d1-4833-41fa-9917-3b46dd7b0472 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4342025-01-08T15:30:39.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b63411d1-4833-41fa-9917-3b46dd7b0472 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4352025-01-08T15:30:39.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b63411d1-4833-41fa-9917-3b46dd7b0472 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4362025-01-08T15:30:40.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e010da62-00ea-45ae-98fc-d1532b189bb1 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4372025-01-08T15:30:40.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e010da62-00ea-45ae-98fc-d1532b189bb1 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4382025-01-08T15:30:40.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e010da62-00ea-45ae-98fc-d1532b189bb1 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4392025-01-08T15:30:41.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = bb614df3-1d02-43fa-b055-c03607c9ad1d roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4402025-01-08T15:30:41.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = bb614df3-1d02-43fa-b055-c03607c9ad1d resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4412025-01-08T15:30:41.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = bb614df3-1d02-43fa-b055-c03607c9ad1d response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4422025-01-08T15:30:42.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 926bb90d-8275-41de-9dc4-717b38c608d7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
4432025-01-08T15:30:42.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 926bb90d-8275-41de-9dc4-717b38c608d7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
4442025-01-08T15:30:42.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 926bb90d-8275-41de-9dc4-717b38c608d7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
4452025-01-08T15:30:42.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 25471ca0-f89c-4601-aacf-989cbd08af36 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
4462025-01-08T15:30:42.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 25471ca0-f89c-4601-aacf-989cbd08af36 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
4472025-01-08T15:30:42.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 25471ca0-f89c-4601-aacf-989cbd08af36 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
4482025-01-08T15:30:43.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e3eb0a52-53dc-4bb3-a12c-d5a78e81b448 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4492025-01-08T15:30:43.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e3eb0a52-53dc-4bb3-a12c-d5a78e81b448 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4502025-01-08T15:30:43.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e3eb0a52-53dc-4bb3-a12c-d5a78e81b448 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4512025-01-08T15:30:44.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 57ed2fb5-1668-4072-a8e6-f75a69fa9a14 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4522025-01-08T15:30:44.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 57ed2fb5-1668-4072-a8e6-f75a69fa9a14 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4532025-01-08T15:30:44.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 57ed2fb5-1668-4072-a8e6-f75a69fa9a14 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4542025-01-08T15:30:45.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 57334070-8dfe-4c92-8c38-3badeed7b615 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4552025-01-08T15:30:45.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 57334070-8dfe-4c92-8c38-3badeed7b615 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4562025-01-08T15:30:45.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 57334070-8dfe-4c92-8c38-3badeed7b615 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4572025-01-08T15:30:46.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cffd8ee8-7bef-498f-801b-0df1cce8dd86 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4582025-01-08T15:30:46.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cffd8ee8-7bef-498f-801b-0df1cce8dd86 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4592025-01-08T15:30:46.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cffd8ee8-7bef-498f-801b-0df1cce8dd86 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4602025-01-08T15:30:46.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1695 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = 6766edc8-87ee-405b-a0ef-09e5fb444538 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
4612025-01-08T15:30:47.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e6a10ca9-82c8-48a2-a708-c85ab9309814 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4622025-01-08T15:30:47.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e6a10ca9-82c8-48a2-a708-c85ab9309814 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4632025-01-08T15:30:47.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e6a10ca9-82c8-48a2-a708-c85ab9309814 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4642025-01-08T15:30:48.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = af887d87-a48b-4e85-80ab-bca8000d04c8 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4652025-01-08T15:30:48.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = af887d87-a48b-4e85-80ab-bca8000d04c8 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4662025-01-08T15:30:48.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = af887d87-a48b-4e85-80ab-bca8000d04c8 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
4672025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
4682025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
4692025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4702025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
4712025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
4722025-01-08T15:30:48.604ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-08 15:20:48.604845500 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4732025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4742025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4752025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
4762025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
4772025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4782025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4792025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
4802025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
4812025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4822025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4832025-01-08T15:30:48.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
4842025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4852025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
4862025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
4872025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4882025-01-08T15:30:48.605ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4892025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4902025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
4912025-01-08T15:30:48.605ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f
4922025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
4932025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.251\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f"}
4942025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
4952025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
4962025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4972025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
4982025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4992025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
5002025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
5012025-01-08T15:30:48.605ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
5022025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5032025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
5042025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5052025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5062025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5072025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
5082025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5092025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5102025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
5112025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5122025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
5132025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5142025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
5152025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5162025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
5172025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5182025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5192025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
5202025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
5212025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
5222025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
5232025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5242025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5252025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5262025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
5272025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5282025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5292025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5302025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
5312025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5322025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5332025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5342025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5352025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5362025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5372025-01-08T15:30:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5382025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5392025-01-08T15:30:48.606ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4ac9516f-ce2b-441e-b6e1-c7e068dc9b60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("546529ac-9cd3-4187-a253-14c651454456.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("546529ac-9cd3-4187-a253-14c651454456.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 37412, tv_nsec: 735806068 } })
5402025-01-08T15:30:48.606ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd3e994a-ca27-4475-b826-d1843113ddee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c83545e9-4211-4dca-9ec0-0f110abfca92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea871c24-fe68-43ce-af24-67c6f74ea37d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea871c24-fe68-43ce-af24-67c6f74ea37d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 37412, tv_nsec: 735810599 } })
5412025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5422025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5432025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5442025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5452025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5462025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5472025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5482025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5492025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5502025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5512025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5522025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5532025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5542025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5552025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
5562025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.216527ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5572025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
5582025-01-08T15:30:48.606ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.652713ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5592025-01-08T15:30:48.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5602025-01-08T15:30:48.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5612025-01-08T15:30:48.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37412, tv_nsec: 737911499 } })
5622025-01-08T15:30:48.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5632025-01-08T15:30:48.608ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.566421ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5642025-01-08T15:30:48.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5652025-01-08T15:30:48.608ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-08 15:20:48.604845500 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5662025-01-08T15:30:48.608ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.841685ms iteration = 12 status = {"expiration":"2025-01-08T15:20:48.604845500Z","pruned":[]}
5672025-01-08T15:30:48.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5682025-01-08T15:30:48.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692025-01-08T15:30:48.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5702025-01-08T15:30:48.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5712025-01-08T15:30:48.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5722025-01-08T15:30:48.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5732025-01-08T15:30:48.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37412, tv_nsec: 743075553 } })
5742025-01-08T15:30:48.613ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5752025-01-08T15:30:48.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5762025-01-08T15:30:48.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772025-01-08T15:30:48.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5782025-01-08T15:30:48.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5792025-01-08T15:30:48.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5802025-01-08T15:30:48.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5812025-01-08T15:30:48.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5822025-01-08T15:30:48.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5832025-01-08T15:30:48.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5842025-01-08T15:30:48.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5852025-01-08T15:30:48.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5862025-01-08T15:30:48.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5872025-01-08T15:30:48.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5882025-01-08T15:30:48.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5892025-01-08T15:30:48.619ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5902025-01-08T15:30:48.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5912025-01-08T15:30:48.620ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5922025-01-08T15:30:48.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5932025-01-08T15:30:48.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5942025-01-08T15:30:48.621ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5952025-01-08T15:30:48.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5962025-01-08T15:30:48.624ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.609639ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
5972025-01-08T15:30:48.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982025-01-08T15:30:48.629ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5992025-01-08T15:30:48.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6002025-01-08T15:30:48.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6012025-01-08T15:30:48.636ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6022025-01-08T15:30:48.636ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6032025-01-08T15:30:48.636ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6042025-01-08T15:30:48.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6052025-01-08T15:30:48.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6062025-01-08T15:30:48.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6072025-01-08T15:30:48.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6082025-01-08T15:30:48.643ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37412, tv_nsec: 772977104 } })
6092025-01-08T15:30:48.643ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
6102025-01-08T15:30:48.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6112025-01-08T15:30:48.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6122025-01-08T15:30:48.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6132025-01-08T15:30:48.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6142025-01-08T15:30:48.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6152025-01-08T15:30:48.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6162025-01-08T15:30:48.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6172025-01-08T15:30:48.652ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6182025-01-08T15:30:48.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6192025-01-08T15:30:48.654ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6202025-01-08T15:30:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6212025-01-08T15:30:48.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6222025-01-08T15:30:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6232025-01-08T15:30:48.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6242025-01-08T15:30:48.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6252025-01-08T15:30:48.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6262025-01-08T15:30:48.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6272025-01-08T15:30:48.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6282025-01-08T15:30:48.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.900423ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6292025-01-08T15:30:48.664ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6302025-01-08T15:30:48.664ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6312025-01-08T15:30:48.664ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6322025-01-08T15:30:48.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6332025-01-08T15:30:48.668ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6342025-01-08T15:30:48.668ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6352025-01-08T15:30:48.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6362025-01-08T15:30:48.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6372025-01-08T15:30:48.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.437807ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
6382025-01-08T15:30:48.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.562093ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
6392025-01-08T15:30:48.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6402025-01-08T15:30:48.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6412025-01-08T15:30:48.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6422025-01-08T15:30:48.675ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6432025-01-08T15:30:48.675ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6442025-01-08T15:30:48.675ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6452025-01-08T15:30:48.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6462025-01-08T15:30:48.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6472025-01-08T15:30:48.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6482025-01-08T15:30:48.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6492025-01-08T15:30:48.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6502025-01-08T15:30:48.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6512025-01-08T15:30:48.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6522025-01-08T15:30:48.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6532025-01-08T15:30:48.679ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6542025-01-08T15:30:48.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6552025-01-08T15:30:48.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6562025-01-08T15:30:48.682ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6572025-01-08T15:30:48.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6582025-01-08T15:30:48.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6592025-01-08T15:30:48.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6602025-01-08T15:30:48.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6612025-01-08T15:30:48.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6622025-01-08T15:30:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6632025-01-08T15:30:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6642025-01-08T15:30:48.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.8432ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6652025-01-08T15:30:48.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 79.694938ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
6662025-01-08T15:30:48.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6672025-01-08T15:30:48.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ba54f0e2-bde0-4da7-a58e-566dc5903c14, lookup_type: ById(ba54f0e2-bde0-4da7-a58e-566dc5903c14) } result = Ok(())
6682025-01-08T15:30:48.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6692025-01-08T15:30:48.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6702025-01-08T15:30:48.690ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.038255ms iteration = 23 status = 0
6712025-01-08T15:30:48.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
6722025-01-08T15:30:48.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6732025-01-08T15:30:48.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6742025-01-08T15:30:48.693ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6752025-01-08T15:30:48.693ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6762025-01-08T15:30:48.693ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 87.595932ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6772025-01-08T15:30:48.693ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6782025-01-08T15:30:48.693ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6792025-01-08T15:30:48.693ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6802025-01-08T15:30:48.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6812025-01-08T15:30:48.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6822025-01-08T15:30:48.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6832025-01-08T15:30:48.706ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
6842025-01-08T15:30:48.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.916358ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
6852025-01-08T15:30:48.707ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6862025-01-08T15:30:48.707ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d1ec779f-5a73-494d-b0a9-290833d170fb dns_zone_name = oxide.test found_so_far = 0 version = 2
6872025-01-08T15:30:48.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6882025-01-08T15:30:48.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6892025-01-08T15:30:48.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6902025-01-08T15:30:48.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6912025-01-08T15:30:48.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6922025-01-08T15:30:48.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6932025-01-08T15:30:48.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6942025-01-08T15:30:48.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6952025-01-08T15:30:48.712ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6962025-01-08T15:30:48.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6972025-01-08T15:30:48.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6982025-01-08T15:30:48.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6992025-01-08T15:30:48.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7002025-01-08T15:30:48.720ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7012025-01-08T15:30:48.720ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7022025-01-08T15:30:48.720ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.383782ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7032025-01-08T15:30:48.723ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 117.867059ms iteration = 27 status = {"physical_disks_added":0}
7042025-01-08T15:30:48.723ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7052025-01-08T15:30:48.723ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
7062025-01-08T15:30:48.723ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 118.804762ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7072025-01-08T15:30:48.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.974541ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7082025-01-08T15:30:48.767ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7092025-01-08T15:30:48.770ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7102025-01-08T15:30:48.770ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7112025-01-08T15:30:48.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7122025-01-08T15:30:48.770ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12e7d346-ea8c-4e39-b380-6183cfd4c24a", "content-length": "26", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
7132025-01-08T15:30:48.770ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7142025-01-08T15:30:48.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7152025-01-08T15:30:48.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7162025-01-08T15:30:48.819ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7172025-01-08T15:30:48.833ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 zone_address = fd00:1122:3344:101::2
7182025-01-08T15:30:48.833ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7192025-01-08T15:30:48.833ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b278db93-7baf-4ed7-90c9-973aa1f16661", "content-length": "26", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
7202025-01-08T15:30:48.834ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7212025-01-08T15:30:48.835ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
7222025-01-08T15:30:48.881ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd/state
7232025-01-08T15:30:48.951ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7242025-01-08T15:30:48.951ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7252025-01-08T15:30:48.952ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8d0ad7b-3ca5-4ed2-8f7d-5d87e812a088", "content-length": "523", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
7262025-01-08T15:30:48.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7272025-01-08T15:30:48.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7282025-01-08T15:30:48.955ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7292025-01-08T15:30:48.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7302025-01-08T15:30:48.956ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7312025-01-08T15:30:48.957ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b565e0b-765f-4f5e-8b8a-5a9ad112af57", "content-length": "26", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
7322025-01-08T15:30:48.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7332025-01-08T15:30:48.959ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d1ec779f-5a73-494d-b0a9-290833d170fb dns_zone_name = oxide.test found_so_far = 1 version = 2
7342025-01-08T15:30:48.959ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7352025-01-08T15:30:48.959ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-08 15:20:20.232169 UTC dns_group = external generation = 2
7362025-01-08T15:30:48.959ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 354.859093ms iteration = 13 status = {"generation":2}
7372025-01-08T15:30:48.961ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7382025-01-08T15:30:48.961ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7392025-01-08T15:30:48.961ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7402025-01-08T15:30:48.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7412025-01-08T15:30:48.976ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 371.467392ms iteration = 23 status = {}
7422025-01-08T15:30:48.978ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {4810fedd-8472-4733-b913-e09ac69776fd: {10.151.2.175: {0b211a7f-fef5-41da-96d2-9f2da8bef5f5}, 10.151.2.176: {0b211a7f-fef5-41da-96d2-9f2da8bef5f5}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7432025-01-08T15:30:48.978ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7442025-01-08T15:30:48.979ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1fcf19bc-8874-4dd9-95c5-db54690041b5", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
7452025-01-08T15:30:48.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7462025-01-08T15:30:48.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7472025-01-08T15:30:48.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7482025-01-08T15:30:48.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7492025-01-08T15:30:48.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7502025-01-08T15:30:48.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7512025-01-08T15:30:48.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7522025-01-08T15:30:48.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7532025-01-08T15:30:48.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7542025-01-08T15:30:48.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7552025-01-08T15:30:48.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7562025-01-08T15:30:48.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7572025-01-08T15:30:48.995ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7582025-01-08T15:30:48.995ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f8792d26-cdc7-40a4-9573-1d15840c2466 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7592025-01-08T15:30:48.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7602025-01-08T15:30:48.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7612025-01-08T15:30:48.995ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7622025-01-08T15:30:48.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7632025-01-08T15:30:48.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7642025-01-08T15:30:48.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7652025-01-08T15:30:48.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7662025-01-08T15:30:49.003ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-08T15:19:45.145737Z, time_modified: 2025-01-08T15:19:45.145737Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: af729a51-87ee-4946-b919-b2c335114c91, db_silo: Silo { identity: SiloIdentity { id: af729a51-87ee-4946-b919-b2c335114c91, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-08T15:20:20.181122Z, time_modified: 2025-01-08T15:20:20.181122Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ca6ed1c164ca4828050a33061c1eba4440262a3fb9d99fdb07abd3987dfdf513" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: af729a51-87ee-4946-b919-b2c335114c91, db_silo: Silo { identity: SiloIdentity { id: af729a51-87ee-4946-b919-b2c335114c91, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-08T15:20:20.181122Z, time_modified: 2025-01-08T15:20:20.181122Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ca6ed1c164ca4828050a33061c1eba4440262a3fb9d99fdb07abd3987dfdf513" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
7672025-01-08T15:30:49.003ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 398.123136ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"af729a51-87ee-4946-b919-b2c335114c91","tls_certs":["ca6ed1c164ca4828050a33061c1eba4440262a3fb9d99fdb07abd3987dfdf513"]}},"default_endpoint":{"silo_id":"af729a51-87ee-4946-b919-b2c335114c91","tls_certs":["ca6ed1c164ca4828050a33061c1eba4440262a3fb9d99fdb07abd3987dfdf513"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7682025-01-08T15:30:49.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7692025-01-08T15:30:49.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702025-01-08T15:30:49.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7712025-01-08T15:30:49.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7722025-01-08T15:30:49.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7732025-01-08T15:30:49.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7742025-01-08T15:30:49.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7752025-01-08T15:30:49.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7762025-01-08T15:30:49.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7772025-01-08T15:30:49.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7782025-01-08T15:30:49.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7792025-01-08T15:30:49.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: af729a51-87ee-4946-b919-b2c335114c91, lookup_type: ById(af729a51-87ee-4946-b919-b2c335114c91) }, key: 13498b36-527b-4682-bddc-0c398aa8da2c, lookup_type: ById(13498b36-527b-4682-bddc-0c398aa8da2c) }, key: b0d6b5fc-a331-4743-b466-19627646d7fb, lookup_type: ById(b0d6b5fc-a331-4743-b466-19627646d7fb) }, key: d025d49a-6fea-4343-8957-b5888a4c1e27, lookup_type: ById(d025d49a-6fea-4343-8957-b5888a4c1e27) } result = Ok(())
7802025-01-08T15:30:49.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7812025-01-08T15:30:49.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7822025-01-08T15:30:49.024ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7832025-01-08T15:30:49.024ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "416c7828-b0f9-41d0-b2a4-452dbab4e791", "date": "Wed, 08 Jan 2025 15:30:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7842025-01-08T15:30:49.024ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7852025-01-08T15:30:49.026ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2aba3874-4257-46c3-8e91-b108f2937ded", "date": "Wed, 08 Jan 2025 15:30:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7862025-01-08T15:30:49.026ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7872025-01-08T15:30:49.028ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7882025-01-08T15:30:49.028ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 424.172922ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7892025-01-08T15:30:49.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7902025-01-08T15:30:49.032ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7912025-01-08T15:30:49.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7922025-01-08T15:30:49.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7932025-01-08T15:30:49.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7942025-01-08T15:30:49.038ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f8792d26-cdc7-40a4-9573-1d15840c2466 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7952025-01-08T15:30:49.038ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7962025-01-08T15:30:49.038ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-08 15:20:19.495429 UTC dns_group = internal generation = 1
7972025-01-08T15:30:49.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 433.932902ms iteration = 13 status = {"generation":1}
7982025-01-08T15:30:49.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7992025-01-08T15:30:49.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8002025-01-08T15:30:49.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8012025-01-08T15:30:49.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8022025-01-08T15:30:49.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8032025-01-08T15:30:49.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: af729a51-87ee-4946-b919-b2c335114c91, lookup_type: ById(af729a51-87ee-4946-b919-b2c335114c91) }, key: 13498b36-527b-4682-bddc-0c398aa8da2c, lookup_type: ById(13498b36-527b-4682-bddc-0c398aa8da2c) }, key: b0d6b5fc-a331-4743-b466-19627646d7fb, lookup_type: ById(b0d6b5fc-a331-4743-b466-19627646d7fb) }, key: d025d49a-6fea-4343-8957-b5888a4c1e27, lookup_type: ById(d025d49a-6fea-4343-8957-b5888a4c1e27) } result = Ok(())
8042025-01-08T15:30:49.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8052025-01-08T15:30:49.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8062025-01-08T15:30:49.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8072025-01-08T15:30:49.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8082025-01-08T15:30:49.065ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8092025-01-08T15:30:49.065ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8085bd0-d35e-4e64-b438-1d1f006d70ba", "content-length": "1", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
8102025-01-08T15:30:49.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8112025-01-08T15:30:49.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8122025-01-08T15:30:49.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8132025-01-08T15:30:49.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8142025-01-08T15:30:49.067ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
8152025-01-08T15:30:49.067ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 462.580075ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
8162025-01-08T15:30:49.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8172025-01-08T15:30:49.067ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8182025-01-08T15:30:49.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8192025-01-08T15:30:49.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8202025-01-08T15:30:49.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8212025-01-08T15:30:49.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8222025-01-08T15:30:49.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8232025-01-08T15:30:49.070ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 465.368745ms iteration = 23 status = null
8242025-01-08T15:30:49.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8252025-01-08T15:30:49.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8262025-01-08T15:30:49.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8272025-01-08T15:30:49.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8282025-01-08T15:30:49.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8292025-01-08T15:30:49.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8302025-01-08T15:30:49.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8312025-01-08T15:30:49.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8322025-01-08T15:30:49.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8332025-01-08T15:30:49.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8342025-01-08T15:30:49.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8352025-01-08T15:30:49.110ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
8362025-01-08T15:30:49.110ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bf969e2e-370b-4acb-a56d-87d023fadecc", "date": "Wed, 08 Jan 2025 15:30:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8372025-01-08T15:30:49.110ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8382025-01-08T15:30:49.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8392025-01-08T15:30:49.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8402025-01-08T15:30:49.113ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e562d8a9-c3c5-491e-9788-e1246a3f4d64", "date": "Wed, 08 Jan 2025 15:30:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8412025-01-08T15:30:49.113ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8422025-01-08T15:30:49.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8432025-01-08T15:30:49.115ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "98f8e964-a977-4857-89ed-10da171fba9e", "date": "Wed, 08 Jan 2025 15:30:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8442025-01-08T15:30:49.115ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8452025-01-08T15:30:49.117ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8462025-01-08T15:30:49.117ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 513.015582ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8472025-01-08T15:30:49.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: af729a51-87ee-4946-b919-b2c335114c91, lookup_type: ById(af729a51-87ee-4946-b919-b2c335114c91) }, key: 13498b36-527b-4682-bddc-0c398aa8da2c, lookup_type: ById(13498b36-527b-4682-bddc-0c398aa8da2c) }, key: b0d6b5fc-a331-4743-b466-19627646d7fb, lookup_type: ById(b0d6b5fc-a331-4743-b466-19627646d7fb) }, key: b1dbcf00-9e60-478c-a1d0-22707bb84266, lookup_type: ByName("default") } result = Ok(())
8482025-01-08T15:30:49.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8492025-01-08T15:30:49.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8502025-01-08T15:30:49.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8512025-01-08T15:30:49.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8522025-01-08T15:30:49.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8532025-01-08T15:30:49.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8542025-01-08T15:30:49.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8552025-01-08T15:30:49.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8562025-01-08T15:30:49.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8572025-01-08T15:30:49.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8582025-01-08T15:30:49.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8592025-01-08T15:30:49.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8602025-01-08T15:30:49.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8612025-01-08T15:30:49.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8622025-01-08T15:30:49.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8632025-01-08T15:30:49.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: af729a51-87ee-4946-b919-b2c335114c91, lookup_type: ById(af729a51-87ee-4946-b919-b2c335114c91) }, key: 13498b36-527b-4682-bddc-0c398aa8da2c, lookup_type: ById(13498b36-527b-4682-bddc-0c398aa8da2c) }, key: b0d6b5fc-a331-4743-b466-19627646d7fb, lookup_type: ById(b0d6b5fc-a331-4743-b466-19627646d7fb) }, key: 0b211a7f-fef5-41da-96d2-9f2da8bef5f5, lookup_type: ByName("default") } result = Ok(())
8642025-01-08T15:30:49.138ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8652025-01-08T15:30:49.140ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d3e1e892-9a88-4704-8025-622b34c3a805", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
8662025-01-08T15:30:49.142ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 537.342142ms iteration = 24 status = {}
8672025-01-08T15:30:49.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8682025-01-08T15:30:49.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8692025-01-08T15:30:49.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 282e4d18-7d6e-433f-b8c7-4feca8955bc3 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
8702025-01-08T15:30:49.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 282e4d18-7d6e-433f-b8c7-4feca8955bc3 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
8712025-01-08T15:30:49.187ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8722025-01-08T15:30:49.188ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "579f1673-bd30-4bde-a143-c9f8352acfc3", "content-length": "810", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
8732025-01-08T15:30:49.188ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5171707) }} sled = sock
8742025-01-08T15:30:49.188ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8752025-01-08T15:30:49.188ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8762025-01-08T15:30:49.189ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 584.489541ms iteration = 23 status = {}
8772025-01-08T15:30:49.190ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c89e6001-fd6e-44a5-b55c-f8de6aa423f5, rack_id: fa7d62e1-57d8-49cc-9dd2-a5f8873ea528, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dc3d148e-05d3-48a7-97ee-42577ccf7e15) } rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0
8782025-01-08T15:30:49.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8792025-01-08T15:30:49.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 282e4d18-7d6e-433f-b8c7-4feca8955bc3 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
8802025-01-08T15:30:49.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8812025-01-08T15:30:49.201ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8822025-01-08T15:30:49.201ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6558741e-8297-4a12-8790-23bc18d8f7be", "content-length": "134", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
8832025-01-08T15:30:49.201ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8842025-01-08T15:30:49.201ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dc3d148e-05d3-48a7-97ee-42577ccf7e15
8852025-01-08T15:30:49.202ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8862025-01-08T15:30:49.202ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8872025-01-08T15:30:49.202ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8882025-01-08T15:30:49.202ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8892025-01-08T15:30:49.202ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8902025-01-08T15:30:49.202ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8912025-01-08T15:30:49.202ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8922025-01-08T15:30:49.202ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8932025-01-08T15:30:49.202ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
8942025-01-08T15:30:49.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8952025-01-08T15:30:49.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8962025-01-08T15:30:49.204ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8972025-01-08T15:30:49.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b22f52c-7abc-4713-90a9-7dc7eb471e2a", "content-length": "2", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
8982025-01-08T15:30:49.204ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8992025-01-08T15:30:49.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "52568f7f-1810-47a3-b55c-4f3f82f37cba", "content-length": "51", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
9002025-01-08T15:30:49.204ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0
9012025-01-08T15:30:49.204ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9022025-01-08T15:30:49.303ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3f2b7aff-641e-4034-b1a3-3a0f3b8becbe", "date": "Wed, 08 Jan 2025 15:30:48 GMT"} })
9032025-01-08T15:30:49.304ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch = Switch0
9042025-01-08T15:30:49.304ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9052025-01-08T15:30:49.304ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d553276d-f8b9-4031-a103-70ba7448f45f", "content-length": "682", "date": "Wed, 08 Jan 2025 15:30:49 GMT"} })
9062025-01-08T15:30:49.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9072025-01-08T15:30:49.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9082025-01-08T15:30:49.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9092025-01-08T15:30:49.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9102025-01-08T15:30:49.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9112025-01-08T15:30:49.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9122025-01-08T15:30:49.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9132025-01-08T15:30:49.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9142025-01-08T15:30:49.323ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 718.846177ms iteration = 23 status = {}
9152025-01-08T15:30:50.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 61e5b3a4-4c36-4913-a3a3-5b6ced6a54c3 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9162025-01-08T15:30:50.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 61e5b3a4-4c36-4913-a3a3-5b6ced6a54c3 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9172025-01-08T15:30:50.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2864 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 61e5b3a4-4c36-4913-a3a3-5b6ced6a54c3 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9182025-01-08T15:30:50.530ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "d97263d0-77bc-4718-beb6-f38145fa14e3", "content-length": "131", "date": "Wed, 08 Jan 2025 15:30:50 GMT"} })
9192025-01-08T15:30:50.530ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-08T15:30:42.652082695Z }, migration_in: None, migration_out: None } vmm_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9202025-01-08T15:30:50.530ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 vmm_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-08T15:30:42.652082695Z }
9212025-01-08T15:30:50.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 roles = RoleSet { roles: {} } sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 vmm_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9222025-01-08T15:30:50.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 resource = Database result = Ok(()) sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 vmm_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9232025-01-08T15:30:50.534ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a3696da9-3d5d-4875-973e-c897884f5243 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-08T15:30:50.530558765Z }
9242025-01-08T15:30:50.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a3696da9-3d5d-4875-973e-c897884f5243 roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9252025-01-08T15:30:50.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a3696da9-3d5d-4875-973e-c897884f5243 resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9262025-01-08T15:30:50.563ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:50344
9272025-01-08T15:30:50.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:50344 req_id = 1495f992-6985-47d9-82da-4f49c7898ce8 roles = RoleSet { roles: {} } uri = /metrics/producers
9282025-01-08T15:30:50.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:50344 req_id = 1495f992-6985-47d9-82da-4f49c7898ce8 resource = Database result = Ok(()) uri = /metrics/producers
9292025-01-08T15:30:50.566ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
9302025-01-08T15:30:50.567ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.962467675s iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
9312025-01-08T15:30:50.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40210 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a3696da9-3d5d-4875-973e-c897884f5243 response_code = 204 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9322025-01-08T15:30:50.573ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fcd29a1f-7b66-4ab6-af5d-a2abba6b6291 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-08T15:30:50.573125998Z }
9332025-01-08T15:30:50.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fcd29a1f-7b66-4ab6-af5d-a2abba6b6291 roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9342025-01-08T15:30:50.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fcd29a1f-7b66-4ab6-af5d-a2abba6b6291 resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9352025-01-08T15:30:50.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8851 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fcd29a1f-7b66-4ab6-af5d-a2abba6b6291 response_code = 204 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9362025-01-08T15:30:50.598ZINFOnexus: assigned collector to new producer collector_id = f71f2083-2d2b-4618-9504-0628977ed486 file = nexus/src/app/oximeter.rs:76 producer_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1
9372025-01-08T15:30:50.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34465 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:50344 req_id = 1495f992-6985-47d9-82da-4f49c7898ce8 response_code = 201 uri = /metrics/producers
9382025-01-08T15:30:51.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f47b5bda-03b9-4b07-97c0-4e0ba0f40894 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9392025-01-08T15:30:51.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f47b5bda-03b9-4b07-97c0-4e0ba0f40894 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9402025-01-08T15:30:51.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f47b5bda-03b9-4b07-97c0-4e0ba0f40894 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9412025-01-08T15:30:52.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e1d46ff9-cec3-47c1-8a5a-f938a37dad78 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9422025-01-08T15:30:52.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e1d46ff9-cec3-47c1-8a5a-f938a37dad78 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9432025-01-08T15:30:52.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e1d46ff9-cec3-47c1-8a5a-f938a37dad78 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9442025-01-08T15:30:53.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 69c1c38d-7a94-44c9-94f8-205f2f533cd2 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9452025-01-08T15:30:53.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 69c1c38d-7a94-44c9-94f8-205f2f533cd2 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9462025-01-08T15:30:53.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 69c1c38d-7a94-44c9-94f8-205f2f533cd2 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9472025-01-08T15:30:54.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 5cd9b21d-5104-4e9f-b8ff-9e110ad16ca9 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9482025-01-08T15:30:54.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 5cd9b21d-5104-4e9f-b8ff-9e110ad16ca9 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9492025-01-08T15:30:54.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 5cd9b21d-5104-4e9f-b8ff-9e110ad16ca9 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9502025-01-08T15:30:55.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e5139d89-f68c-44e2-b48d-5cb06240f6a9 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9512025-01-08T15:30:55.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e5139d89-f68c-44e2-b48d-5cb06240f6a9 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9522025-01-08T15:30:55.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e5139d89-f68c-44e2-b48d-5cb06240f6a9 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9532025-01-08T15:30:56.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 51902aab-305d-4008-9fea-fbbaf400125e roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9542025-01-08T15:30:56.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 51902aab-305d-4008-9fea-fbbaf400125e resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9552025-01-08T15:30:56.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 51902aab-305d-4008-9fea-fbbaf400125e response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9562025-01-08T15:30:56.789ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4902 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = 749192a8-7a1f-4fbe-8fc6-47191154888a response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
9572025-01-08T15:30:57.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2cb8690d-dc2d-4f8a-8a05-65e45c9ed71a roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9582025-01-08T15:30:57.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2cb8690d-dc2d-4f8a-8a05-65e45c9ed71a resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9592025-01-08T15:30:57.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2cb8690d-dc2d-4f8a-8a05-65e45c9ed71a response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9602025-01-08T15:30:58.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 107e66ec-5218-4516-8165-5a140a83aa31 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9612025-01-08T15:30:58.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 107e66ec-5218-4516-8165-5a140a83aa31 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9622025-01-08T15:30:58.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 107e66ec-5218-4516-8165-5a140a83aa31 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9632025-01-08T15:30:58.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
9642025-01-08T15:30:58.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
9652025-01-08T15:30:58.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9662025-01-08T15:30:58.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9672025-01-08T15:30:58.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9682025-01-08T15:30:58.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9692025-01-08T15:30:58.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9702025-01-08T15:30:58.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9712025-01-08T15:30:58.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9722025-01-08T15:30:58.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9732025-01-08T15:30:58.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9742025-01-08T15:30:58.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9752025-01-08T15:30:58.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9762025-01-08T15:30:58.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9772025-01-08T15:30:58.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9782025-01-08T15:30:58.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
9792025-01-08T15:30:58.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9802025-01-08T15:30:58.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9812025-01-08T15:30:58.630ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
9822025-01-08T15:30:58.630ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.395406ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
9832025-01-08T15:30:58.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.969237ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9842025-01-08T15:30:59.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 488bb85a-71b8-4884-9587-d4308e5ddca3 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9852025-01-08T15:30:59.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 488bb85a-71b8-4884-9587-d4308e5ddca3 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9862025-01-08T15:30:59.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 488bb85a-71b8-4884-9587-d4308e5ddca3 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9872025-01-08T15:31:00.248ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a8e1ddea-8d2a-4c94-8f22-25d6747833dd uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-08T15:31:00.248575648Z }
9882025-01-08T15:31:00.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a8e1ddea-8d2a-4c94-8f22-25d6747833dd roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9892025-01-08T15:31:00.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a8e1ddea-8d2a-4c94-8f22-25d6747833dd resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9902025-01-08T15:31:00.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37804 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a8e1ddea-8d2a-4c94-8f22-25d6747833dd response_code = 204 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
9912025-01-08T15:31:00.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 51e012fc-fb72-438c-a658-6d25d65c6436 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9922025-01-08T15:31:00.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 51e012fc-fb72-438c-a658-6d25d65c6436 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9932025-01-08T15:31:00.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 51e012fc-fb72-438c-a658-6d25d65c6436 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
9942025-01-08T15:31:00.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = ae7f3e41-3c72-45d6-8ec3-ebb8e0f84f10 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
9952025-01-08T15:31:00.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = ae7f3e41-3c72-45d6-8ec3-ebb8e0f84f10 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
9962025-01-08T15:31:00.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = ae7f3e41-3c72-45d6-8ec3-ebb8e0f84f10 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
9972025-01-08T15:31:00.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 22a0aa98-253d-4664-b781-41223c120074 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
9982025-01-08T15:31:00.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 22a0aa98-253d-4664-b781-41223c120074 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
9992025-01-08T15:31:00.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 22a0aa98-253d-4664-b781-41223c120074 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
10002025-01-08T15:31:01.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 824b8603-a71a-4c09-8c47-1b5411a711fc roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
10012025-01-08T15:31:01.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 824b8603-a71a-4c09-8c47-1b5411a711fc resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
10022025-01-08T15:31:01.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 824b8603-a71a-4c09-8c47-1b5411a711fc response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
10032025-01-08T15:31:01.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 7523b073-7828-4203-8244-b48253363bd6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
10042025-01-08T15:31:01.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 7523b073-7828-4203-8244-b48253363bd6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
10052025-01-08T15:31:01.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 7523b073-7828-4203-8244-b48253363bd6 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
10062025-01-08T15:31:02.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 16eda260-3cca-4530-beb1-f929e4a18a33 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
10072025-01-08T15:31:02.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 16eda260-3cca-4530-beb1-f929e4a18a33 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
10082025-01-08T15:31:02.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 16eda260-3cca-4530-beb1-f929e4a18a33 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
10092025-01-08T15:31:02.693ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-08T15:31:02.693033458Z }
10102025-01-08T15:31:02.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10112025-01-08T15:31:02.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10122025-01-08T15:31:02.705ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd vmm_needs_update = true
10132025-01-08T15:31:02.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10142025-01-08T15:31:02.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10152025-01-08T15:31:02.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10162025-01-08T15:31:02.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10172025-01-08T15:31:02.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10182025-01-08T15:31:02.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10192025-01-08T15:31:02.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10202025-01-08T15:31:02.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10212025-01-08T15:31:02.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10222025-01-08T15:31:02.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10232025-01-08T15:31:02.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10242025-01-08T15:31:02.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10252025-01-08T15:31:02.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10262025-01-08T15:31:02.718ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: af729a51-87ee-4946-b919-b2c335114c91, lookup_type: ById(af729a51-87ee-4946-b919-b2c335114c91) }, key: 13498b36-527b-4682-bddc-0c398aa8da2c, lookup_type: ById(13498b36-527b-4682-bddc-0c398aa8da2c) }, key: cdb2d770-f9ae-4e21-bac2-4439befb7fd1, lookup_type: ById(cdb2d770-f9ae-4e21-bac2-4439befb7fd1) } result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10272025-01-08T15:31:02.721ZINFOnexus (dropshot_internal): starting update saga for cdb2d770-f9ae-4e21-bac2-4439befb7fd1 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-08T15:31:02.693033458Z }
10282025-01-08T15:31:02.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27906 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 response_code = 204 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10292025-01-08T15:31:02.721ZDEBGnexus (dropshot_internal): preparing instance-update saga for cdb2d770-f9ae-4e21-bac2-4439befb7fd1... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f8d88aa2-d2e1-42db-9f5a-9145537f9613 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10302025-01-08T15:31:02.721ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update
10312025-01-08T15:31:02.721ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"cdb2d770-f9ae-4e21-bac2-4439befb7fd1","lookup_type":{"ById":"cdb2d770-f9ae-4e21-bac2-4439befb7fd1"},"parent":{"key":"13498b36-527b-4682-bddc-0c398aa8da2c","lookup_type":{"ById":"13498b36-527b-4682-bddc-0c398aa8da2c"},"parent":{"key":"af729a51-87ee-4946-b919-b2c335114c91","lookup_type":{"ById":"af729a51-87ee-4946-b919-b2c335114c91"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10322025-01-08T15:31:02.721ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update
10332025-01-08T15:31:02.721ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 774bc73d-4486-4b80-b03b-0fafc59c347c uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-08T15:31:02.693033458Z }
10342025-01-08T15:31:02.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 774bc73d-4486-4b80-b03b-0fafc59c347c roles = RoleSet { roles: {} } uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10352025-01-08T15:31:02.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 774bc73d-4486-4b80-b03b-0fafc59c347c resource = Database result = Ok(()) uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10362025-01-08T15:31:02.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4349 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 774bc73d-4486-4b80-b03b-0fafc59c347c response_code = 204 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
10372025-01-08T15:31:02.762ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update
10382025-01-08T15:31:02.762ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10392025-01-08T15:31:02.762ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10402025-01-08T15:31:02.762ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
10412025-01-08T15:31:02.768ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10422025-01-08T15:31:02.768ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
10432025-01-08T15:31:02.773ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10442025-01-08T15:31:02.773ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
10452025-01-08T15:31:02.776ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10462025-01-08T15:31:02.776ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a2ecf2a0-966a-4434-8803-9b79a62caea6")) node_id = 0 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
10472025-01-08T15:31:02.782ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10482025-01-08T15:31:02.782ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
10492025-01-08T15:31:02.789ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update
10502025-01-08T15:31:02.789ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10512025-01-08T15:31:02.789ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10522025-01-08T15:31:02.791ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10532025-01-08T15:31:02.791ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10542025-01-08T15:31:02.792ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10552025-01-08T15:31:02.793ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10562025-01-08T15:31:02.794ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10572025-01-08T15:31:02.794ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10582025-01-08T15:31:02.796ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10592025-01-08T15:31:02.796ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10602025-01-08T15:31:02.797ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10612025-01-08T15:31:02.798ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10622025-01-08T15:31:02.799ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10632025-01-08T15:31:02.802ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: af729a51-87ee-4946-b919-b2c335114c91, lookup_type: ById(af729a51-87ee-4946-b919-b2c335114c91) }, key: 13498b36-527b-4682-bddc-0c398aa8da2c, lookup_type: ById(13498b36-527b-4682-bddc-0c398aa8da2c) }, key: cdb2d770-f9ae-4e21-bac2-4439befb7fd1, lookup_type: ById(cdb2d770-f9ae-4e21-bac2-4439befb7fd1) } result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10642025-01-08T15:31:02.802ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance updater_id = a2ecf2a0-966a-4434-8803-9b79a62caea6
10652025-01-08T15:31:02.802ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10662025-01-08T15:31:02.802ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10672025-01-08T15:31:02.812ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance updater_id = a2ecf2a0-966a-4434-8803-9b79a62caea6
10682025-01-08T15:31:02.813ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10692025-01-08T15:31:02.813ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance
10702025-01-08T15:31:02.817ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 locked_gen = Generation(Generation(2)) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = LockInstance updater_id = a2ecf2a0-966a-4434-8803-9b79a62caea6
10712025-01-08T15:31:02.817ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10722025-01-08T15:31:02.817ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("a2ecf2a0-966a-4434-8803-9b79a62caea6")}) node_id = 1 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
10732025-01-08T15:31:02.821ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10742025-01-08T15:31:02.821ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
10752025-01-08T15:31:02.827ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10762025-01-08T15:31:02.828ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10772025-01-08T15:31:02.829ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10782025-01-08T15:31:02.829ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10792025-01-08T15:31:02.830ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10802025-01-08T15:31:02.830ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10812025-01-08T15:31:02.831ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10822025-01-08T15:31:02.834ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: af729a51-87ee-4946-b919-b2c335114c91, lookup_type: ById(af729a51-87ee-4946-b919-b2c335114c91) }, key: 13498b36-527b-4682-bddc-0c398aa8da2c, lookup_type: ById(13498b36-527b-4682-bddc-0c398aa8da2c) }, key: cdb2d770-f9ae-4e21-bac2-4439befb7fd1, lookup_type: ById(cdb2d770-f9ae-4e21-bac2-4439befb7fd1) } result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10832025-01-08T15:31:02.834ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10842025-01-08T15:31:02.834ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10852025-01-08T15:31:02.840ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: d1c7ca53-31be-4a7e-8070-174ba6c8d6fd, time_created: 2025-01-08T15:30:42.168738Z, time_deleted: None, instance_id: cdb2d770-f9ae-4e21-bac2-4439befb7fd1, sled_id: ba54f0e2-bde0-4da7-a58e-566dc5903c14, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-08T15:31:02.693033Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-08T15:30:40.081841Z, gen: Generation(Generation(3)), propolis_id: Some(d1c7ca53-31be-4a7e-8070-174ba6c8d6fd), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(d1c7ca53-31be-4a7e-8070-174ba6c8d6fd (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-08T15:31:02.840410901Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
10862025-01-08T15:31:02.844ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
10872025-01-08T15:31:02.844ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"cdb2d770-f9ae-4e21-bac2-4439befb7fd1","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"d1c7ca53-31be-4a7e-8070-174ba6c8d6fd"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"cdb2d770-f9ae-4e21-bac2-4439befb7fd1","lookup_type":{"ById":"cdb2d770-f9ae-4e21-bac2-4439befb7fd1"},"parent":{"key":"13498b36-527b-4682-bddc-0c398aa8da2c","lookup_type":{"ById":"13498b36-527b-4682-bddc-0c398aa8da2c"},"parent":{"key":"af729a51-87ee-4946-b919-b2c335114c91","lookup_type":{"ById":"af729a51-87ee-4946-b919-b2c335114c91"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"a2ecf2a0-966a-4434-8803-9b79a62caea6"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"13498b36-527b-4682-bddc-0c398aa8da2c","ram_diff":1073741824},"destroy_active_vmm":"d1c7ca53-31be-4a7e-8070-174ba6c8d6fd","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-08T15:31:02.840410901Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10882025-01-08T15:31:02.844ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
10892025-01-08T15:31:02.890ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
10902025-01-08T15:31:02.890ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10912025-01-08T15:31:02.890ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10922025-01-08T15:31:02.890ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
10932025-01-08T15:31:02.894ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10942025-01-08T15:31:02.894ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
10952025-01-08T15:31:02.898ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10962025-01-08T15:31:02.898ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
10972025-01-08T15:31:02.901ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
10982025-01-08T15:31:02.901ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c7cf1516-0e03-4a0f-8de5-36cb4e7de046")) node_id = 0 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
10992025-01-08T15:31:02.904ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11002025-01-08T15:31:02.904ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11012025-01-08T15:31:02.911ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 parent_lock = UpdaterLock { updater_id: a2ecf2a0-966a-4434-8803-9b79a62caea6, locked_gen: Generation(Generation(2)) } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11022025-01-08T15:31:02.911ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = BecomeUpdater
11032025-01-08T15:31:02.911ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = BecomeUpdater
11042025-01-08T15:31:02.932ZDEBGnexus (SagaExecutor): inherited lock from a2ecf2a0-966a-4434-8803-9b79a62caea6 to c7cf1516-0e03-4a0f-8de5-36cb4e7de046 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = a2ecf2a0-966a-4434-8803-9b79a62caea6 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = BecomeUpdater updater_id = c7cf1516-0e03-4a0f-8de5-36cb4e7de046
11052025-01-08T15:31:02.932ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11062025-01-08T15:31:02.932ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11072025-01-08T15:31:02.932ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c7cf1516-0e03-4a0f-8de5-36cb4e7de046")}) node_id = 1 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11082025-01-08T15:31:02.939ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11092025-01-08T15:31:02.939ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11102025-01-08T15:31:02.943ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11112025-01-08T15:31:02.943ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11122025-01-08T15:31:02.947ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11132025-01-08T15:31:02.947ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11142025-01-08T15:31:02.951ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11152025-01-08T15:31:02.953ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1
11162025-01-08T15:31:02.955ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = UpdateNetworkConfig
11172025-01-08T15:31:02.955ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = UpdateNetworkConfig
11182025-01-08T15:31:02.958ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = UpdateNetworkConfig
11192025-01-08T15:31:02.959ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = UpdateNetworkConfig
11202025-01-08T15:31:02.961ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
11212025-01-08T15:31:02.961ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = UpdateNetworkConfig
11222025-01-08T15:31:02.961ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = UpdateNetworkConfig
11232025-01-08T15:31:02.964ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
11242025-01-08T15:31:02.964ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
11252025-01-08T15:31:02.964ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
11262025-01-08T15:31:02.965ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
11272025-01-08T15:31:02.966ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
11282025-01-08T15:31:02.966ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
11292025-01-08T15:31:02.967ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
11302025-01-08T15:31:02.971ZDEBGnexus: notifying dendrite of updates instance_id = Some(cdb2d770-f9ae-4e21-bac2-4439befb7fd1 (instance)) switch = switch0
11312025-01-08T15:31:02.971ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37427, tv_nsec: 101505115 } })
11322025-01-08T15:31:02.971ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
11332025-01-08T15:31:03.001ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11342025-01-08T15:31:03.001ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11352025-01-08T15:31:03.002ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "15d3914c-1442-4bad-8d8d-762be245260b", "content-length": "26", "date": "Wed, 08 Jan 2025 15:31:03 GMT"} })
11362025-01-08T15:31:03.002ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11372025-01-08T15:31:03.003ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11382025-01-08T15:31:03.032ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
11392025-01-08T15:31:03.032ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "d85d5f83-4ba2-4dce-9b24-f9483de8e7c8", "content-length": "4", "date": "Wed, 08 Jan 2025 15:31:02 GMT"} })
11402025-01-08T15:31:03.033ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11412025-01-08T15:31:03.033ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11422025-01-08T15:31:03.038ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11432025-01-08T15:31:03.038ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11442025-01-08T15:31:03.050ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
11452025-01-08T15:31:03.050ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
11462025-01-08T15:31:03.069ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-08T15:31:03.053202Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 13498b36-527b-4682-bddc-0c398aa8da2c, time_modified: Some(2025-01-08T15:31:03.053202Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: af729a51-87ee-4946-b919-b2c335114c91, time_modified: Some(2025-01-08T15:31:03.053202Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11472025-01-08T15:31:03.070ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11482025-01-08T15:31:03.070ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11492025-01-08T15:31:03.076ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11502025-01-08T15:31:03.076ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11512025-01-08T15:31:03.083ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11522025-01-08T15:31:03.083ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = UnassignOximeterProducer
11532025-01-08T15:31:03.084ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = UnassignOximeterProducer
11542025-01-08T15:31:03.093ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = f71f2083-2d2b-4618-9504-0628977ed486 producer_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11552025-01-08T15:31:03.093ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = UnassignOximeterProducer
11562025-01-08T15:31:03.093ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = UnassignOximeterProducer
11572025-01-08T15:31:03.128ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11582025-01-08T15:31:03.130ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/cdb2d770-f9ae-4e21-bac2-4439befb7fd1
11592025-01-08T15:31:03.147ZDEBGnexus (SagaExecutor): client response oximeter-collector = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/cdb2d770-f9ae-4e21-bac2-4439befb7fd1", status: 204, headers: {"x-request-id": "779a3d90-9cbe-4298-89eb-353685f2c498", "date": "Wed, 08 Jan 2025 15:31:03 GMT"} }) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11602025-01-08T15:31:03.147ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = f71f2083-2d2b-4618-9504-0628977ed486 producer_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11612025-01-08T15:31:03.148ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11622025-01-08T15:31:03.148ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11632025-01-08T15:31:03.153ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11642025-01-08T15:31:03.153ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11652025-01-08T15:31:03.157ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 lock = UpdaterLock { updater_id: c7cf1516-0e03-4a0f-8de5-36cb4e7de046, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-08T15:31:02.840410901Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11662025-01-08T15:31:03.157ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = CommitInstanceUpdates
11672025-01-08T15:31:03.157ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = CommitInstanceUpdates
11682025-01-08T15:31:03.207ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 new_runtime = InstanceRuntimeState { time_updated: 2025-01-08T15:31:02.840410901Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11692025-01-08T15:31:03.207ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11702025-01-08T15:31:03.207ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11712025-01-08T15:31:03.207ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
11722025-01-08T15:31:03.207ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
11732025-01-08T15:31:03.207ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11742025-01-08T15:31:03.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11752025-01-08T15:31:03.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11762025-01-08T15:31:03.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11772025-01-08T15:31:03.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11782025-01-08T15:31:03.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11792025-01-08T15:31:03.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11802025-01-08T15:31:03.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11812025-01-08T15:31:03.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11822025-01-08T15:31:03.212ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11832025-01-08T15:31:03.212ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11842025-01-08T15:31:03.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11852025-01-08T15:31:03.216ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11862025-01-08T15:31:03.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11872025-01-08T15:31:03.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11882025-01-08T15:31:03.221ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11892025-01-08T15:31:03.221ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("cdb2d770-f9ae-4e21-bac2-4439befb7fd1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d1c7ca53-31be-4a7e-8070-174ba6c8d6fd")}) node_id = 7 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11902025-01-08T15:31:03.228ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11912025-01-08T15:31:03.228ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11922025-01-08T15:31:03.239ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11932025-01-08T15:31:03.239ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11942025-01-08T15:31:03.247ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
11952025-01-08T15:31:03.247ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
11962025-01-08T15:31:03.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11972025-01-08T15:31:03.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11982025-01-08T15:31:03.253ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
11992025-01-08T15:31:03.253ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ReleaseSledResources
12002025-01-08T15:31:03.254ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ReleaseSledResources
12012025-01-08T15:31:03.267ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12022025-01-08T15:31:03.267ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
12032025-01-08T15:31:03.274ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12042025-01-08T15:31:03.274ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
12052025-01-08T15:31:03.281ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
12062025-01-08T15:31:03.281ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = MarkVmmDeleted
12072025-01-08T15:31:03.282ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = MarkVmmDeleted
12082025-01-08T15:31:03.294ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12092025-01-08T15:31:03.294ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
12102025-01-08T15:31:03.316ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12112025-01-08T15:31:03.316ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12122025-01-08T15:31:03.316ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a37ded20-22e2-4aca-8b49-6fa5a5ae1626", "content-length": "372", "date": "Wed, 08 Jan 2025 15:31:03 GMT"} })
12132025-01-08T15:31:03.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12142025-01-08T15:31:03.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12152025-01-08T15:31:03.320ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12162025-01-08T15:31:03.320ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
12172025-01-08T15:31:03.324ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12182025-01-08T15:31:03.324ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
12192025-01-08T15:31:03.327ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12202025-01-08T15:31:03.327ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
12212025-01-08T15:31:03.331ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ChainSuccessorSaga
12222025-01-08T15:31:03.332ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ChainSuccessorSaga
12232025-01-08T15:31:03.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12242025-01-08T15:31:03.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12252025-01-08T15:31:03.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12262025-01-08T15:31:03.352ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12272025-01-08T15:31:03.352ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12282025-01-08T15:31:03.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12292025-01-08T15:31:03.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12302025-01-08T15:31:03.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12312025-01-08T15:31:03.355ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12322025-01-08T15:31:03.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12332025-01-08T15:31:03.359ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
12342025-01-08T15:31:03.359ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12352025-01-08T15:31:03.360ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bf473459-6ec7-4236-a8e9-205771b13d71", "date": "Wed, 08 Jan 2025 15:31:03 GMT"} })
12362025-01-08T15:31:03.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12372025-01-08T15:31:03.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12382025-01-08T15:31:03.361ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ChainSuccessorSaga
12392025-01-08T15:31:03.361ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ChainSuccessorSaga
12402025-01-08T15:31:03.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12412025-01-08T15:31:03.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12422025-01-08T15:31:03.362ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ChainSuccessorSaga
12432025-01-08T15:31:03.363ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ChainSuccessorSaga
12442025-01-08T15:31:03.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12452025-01-08T15:31:03.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12462025-01-08T15:31:03.367ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12472025-01-08T15:31:03.367ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12482025-01-08T15:31:03.368ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "28424381-f15d-4c87-b931-336cbf7a0c29", "date": "Wed, 08 Jan 2025 15:31:03 GMT"} })
12492025-01-08T15:31:03.369ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 162.037194ms iteration = 25 status = {}
12502025-01-08T15:31:03.390ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ChainSuccessorSaga
12512025-01-08T15:31:03.393ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: af729a51-87ee-4946-b919-b2c335114c91, lookup_type: ById(af729a51-87ee-4946-b919-b2c335114c91) }, key: 13498b36-527b-4682-bddc-0c398aa8da2c, lookup_type: ById(13498b36-527b-4682-bddc-0c398aa8da2c) }, key: cdb2d770-f9ae-4e21-bac2-4439befb7fd1, lookup_type: ById(cdb2d770-f9ae-4e21-bac2-4439befb7fd1) } result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ChainSuccessorSaga
12522025-01-08T15:31:03.393ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ChainSuccessorSaga
12532025-01-08T15:31:03.393ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_node = ChainSuccessorSaga
12542025-01-08T15:31:03.397ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 karmic_state = WillReincarnate needs_reincarnation = false saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update
12552025-01-08T15:31:03.397ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12562025-01-08T15:31:03.397ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
12572025-01-08T15:31:03.402ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12582025-01-08T15:31:03.402ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
12592025-01-08T15:31:03.405ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12602025-01-08T15:31:03.405ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
12612025-01-08T15:31:03.409ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12622025-01-08T15:31:03.409ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35
12632025-01-08T15:31:03.443ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12642025-01-08T15:31:03.444ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "795b0dc8-46af-4c93-8895-b4d5147680be", "content-length": "691", "date": "Wed, 08 Jan 2025 15:31:03 GMT"} })
12652025-01-08T15:31:03.444ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12662025-01-08T15:31:03.444ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12672025-01-08T15:31:03.444ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12682025-01-08T15:31:03.445ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 237.948148ms iteration = 24 status = {}
12692025-01-08T15:31:03.447ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12702025-01-08T15:31:03.448ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 saga_name = instance-update saga_result = SagaResult { saga_id: e0152ecf-5319-4cde-ad63-2828f2d4ea35, saga_log: SagaLog { saga_id: e0152ecf-5319-4cde-ad63-2828f2d4ea35, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("c7cf1516-0e03-4a0f-8de5-36cb4e7de046")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c7cf1516-0e03-4a0f-8de5-36cb4e7de046")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("cdb2d770-f9ae-4e21-bac2-4439befb7fd1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d1c7ca53-31be-4a7e-8070-174ba6c8d6fd")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("cdb2d770-f9ae-4e21-bac2-4439befb7fd1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d1c7ca53-31be-4a7e-8070-174ba6c8d6fd")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("c7cf1516-0e03-4a0f-8de5-36cb4e7de046"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("c7cf1516-0e03-4a0f-8de5-36cb4e7de046")}} }) }
12712025-01-08T15:31:03.448ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = e0152ecf-5319-4cde-ad63-2828f2d4ea35 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update
12722025-01-08T15:31:03.448ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12732025-01-08T15:31:03.448ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
12742025-01-08T15:31:03.452ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12752025-01-08T15:31:03.452ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
12762025-01-08T15:31:03.457ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12772025-01-08T15:31:03.457ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
12782025-01-08T15:31:03.461ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12792025-01-08T15:31:03.461ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 03081edf-84d0-4c98-874e-ce098e577e03
12802025-01-08T15:31:03.515ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update sec_id = 4cece465-e930-47ca-aa88-ed170e15d28a
12812025-01-08T15:31:03.515ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 03081edf-84d0-4c98-874e-ce098e577e03 saga_name = start-instance-update saga_result = SagaResult { saga_id: 03081edf-84d0-4c98-874e-ce098e577e03, saga_log: SagaLog { saga_id: 03081edf-84d0-4c98-874e-ce098e577e03, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("a2ecf2a0-966a-4434-8803-9b79a62caea6")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("a2ecf2a0-966a-4434-8803-9b79a62caea6")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("a2ecf2a0-966a-4434-8803-9b79a62caea6"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("a2ecf2a0-966a-4434-8803-9b79a62caea6")}} }) }
12822025-01-08T15:31:03.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 42259eb1-66e6-43ae-8c5b-d9660c59964c roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12832025-01-08T15:31:03.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 42259eb1-66e6-43ae-8c5b-d9660c59964c resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12842025-01-08T15:31:03.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 42259eb1-66e6-43ae-8c5b-d9660c59964c response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12852025-01-08T15:31:03.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = aca46868-cc46-4ca5-929c-a3132f1a87dd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
12862025-01-08T15:31:03.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = aca46868-cc46-4ca5-929c-a3132f1a87dd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
12872025-01-08T15:31:03.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = aca46868-cc46-4ca5-929c-a3132f1a87dd response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
12882025-01-08T15:31:04.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 986f498d-53fb-4779-908f-975d2ebc1e59 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12892025-01-08T15:31:04.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 986f498d-53fb-4779-908f-975d2ebc1e59 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12902025-01-08T15:31:04.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2687 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 986f498d-53fb-4779-908f-975d2ebc1e59 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12912025-01-08T15:31:04.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 29dea64d-3fb6-45f6-9200-1a6c470dff11 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
12922025-01-08T15:31:04.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 29dea64d-3fb6-45f6-9200-1a6c470dff11 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
12932025-01-08T15:31:04.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 29dea64d-3fb6-45f6-9200-1a6c470dff11 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
12942025-01-08T15:31:05.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c8904223-2682-41d0-a8c9-d1bfe77e13b0 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12952025-01-08T15:31:05.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c8904223-2682-41d0-a8c9-d1bfe77e13b0 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12962025-01-08T15:31:05.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c8904223-2682-41d0-a8c9-d1bfe77e13b0 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12972025-01-08T15:31:06.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 97a96297-fd41-4ec2-b967-de8fb1c45479 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12982025-01-08T15:31:06.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 97a96297-fd41-4ec2-b967-de8fb1c45479 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
12992025-01-08T15:31:06.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 97a96297-fd41-4ec2-b967-de8fb1c45479 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13002025-01-08T15:31:06.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1414 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = fbe14d0e-5f49-4e35-9cd6-067c848e286d response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
13012025-01-08T15:31:07.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6b55f28d-b3ba-46d7-8363-ee4f5cc4ffdc roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13022025-01-08T15:31:07.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6b55f28d-b3ba-46d7-8363-ee4f5cc4ffdc resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13032025-01-08T15:31:07.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6b55f28d-b3ba-46d7-8363-ee4f5cc4ffdc response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13042025-01-08T15:31:08.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
13052025-01-08T15:31:08.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
13062025-01-08T15:31:08.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13072025-01-08T15:31:08.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13082025-01-08T15:31:08.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13092025-01-08T15:31:08.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13102025-01-08T15:31:08.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13112025-01-08T15:31:08.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13122025-01-08T15:31:08.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13132025-01-08T15:31:08.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13142025-01-08T15:31:08.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13152025-01-08T15:31:08.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13162025-01-08T15:31:08.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13172025-01-08T15:31:08.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
13182025-01-08T15:31:08.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13192025-01-08T15:31:08.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13202025-01-08T15:31:08.629ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
13212025-01-08T15:31:08.629ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.005046ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
13222025-01-08T15:31:08.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13232025-01-08T15:31:08.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13242025-01-08T15:31:08.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.020398ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13252025-01-08T15:31:08.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 36d9d820-f70e-4540-bbae-72836ab7d5a1 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13262025-01-08T15:31:08.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 36d9d820-f70e-4540-bbae-72836ab7d5a1 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13272025-01-08T15:31:08.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 36d9d820-f70e-4540-bbae-72836ab7d5a1 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13282025-01-08T15:31:09.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 36adaa04-581f-4b7d-94e5-2d3ee1dd5d0a roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13292025-01-08T15:31:09.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 36adaa04-581f-4b7d-94e5-2d3ee1dd5d0a resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13302025-01-08T15:31:09.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 36adaa04-581f-4b7d-94e5-2d3ee1dd5d0a response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13312025-01-08T15:31:10.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2d1af4ca-e588-48e2-aa5f-484f2d0e8382 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13322025-01-08T15:31:10.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2d1af4ca-e588-48e2-aa5f-484f2d0e8382 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13332025-01-08T15:31:10.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2d1af4ca-e588-48e2-aa5f-484f2d0e8382 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13342025-01-08T15:31:11.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = abeb31ff-2faa-494a-952a-6d0ea247cab3 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13352025-01-08T15:31:11.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = abeb31ff-2faa-494a-952a-6d0ea247cab3 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13362025-01-08T15:31:11.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = abeb31ff-2faa-494a-952a-6d0ea247cab3 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13372025-01-08T15:31:12.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = ed489812-5fcf-446f-b7a3-166354806088 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13382025-01-08T15:31:12.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = ed489812-5fcf-446f-b7a3-166354806088 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13392025-01-08T15:31:12.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = ed489812-5fcf-446f-b7a3-166354806088 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13402025-01-08T15:31:13.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cc38a8d9-8f91-4a75-bbc2-e0ff2a254867 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13412025-01-08T15:31:13.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cc38a8d9-8f91-4a75-bbc2-e0ff2a254867 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13422025-01-08T15:31:13.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cc38a8d9-8f91-4a75-bbc2-e0ff2a254867 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13432025-01-08T15:31:14.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 74d1c860-4df6-448d-a086-1e15dbaf4797 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13442025-01-08T15:31:14.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 74d1c860-4df6-448d-a086-1e15dbaf4797 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13452025-01-08T15:31:14.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 74d1c860-4df6-448d-a086-1e15dbaf4797 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13462025-01-08T15:31:15.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 940bb66d-7e3c-463d-bdc2-1039cff5c8b9 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13472025-01-08T15:31:15.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 940bb66d-7e3c-463d-bdc2-1039cff5c8b9 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13482025-01-08T15:31:15.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 940bb66d-7e3c-463d-bdc2-1039cff5c8b9 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13492025-01-08T15:31:16.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1518 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = f4ab5ee6-ffe4-41b1-acf2-6c864f273078 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
13502025-01-08T15:31:16.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7fd4f1f4-79b2-4880-a8fa-47f47c74230b roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13512025-01-08T15:31:16.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7fd4f1f4-79b2-4880-a8fa-47f47c74230b resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13522025-01-08T15:31:16.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7fd4f1f4-79b2-4880-a8fa-47f47c74230b response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13532025-01-08T15:31:17.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 99b798ed-9ae2-4d97-a626-32cc0fd87314 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13542025-01-08T15:31:17.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 99b798ed-9ae2-4d97-a626-32cc0fd87314 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13552025-01-08T15:31:17.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 99b798ed-9ae2-4d97-a626-32cc0fd87314 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
13562025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
13572025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
13582025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
13592025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13602025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13612025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13622025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13632025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
13642025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13652025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
13662025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13672025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
13682025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
13692025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13702025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
13712025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13722025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
13732025-01-08T15:31:18.605ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13742025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
13752025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13762025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13772025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
13782025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
13792025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13802025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13812025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
13822025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13832025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13842025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13852025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13862025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13872025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13882025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13892025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13902025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13912025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13922025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13932025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13942025-01-08T15:31:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13952025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
13962025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
13972025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13982025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
13992025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14002025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
14012025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14022025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14032025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14042025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14052025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14062025-01-08T15:31:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14072025-01-08T15:31:18.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14082025-01-08T15:31:18.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14092025-01-08T15:31:18.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14102025-01-08T15:31:18.609ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.131209ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14112025-01-08T15:31:18.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14122025-01-08T15:31:18.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14132025-01-08T15:31:18.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14142025-01-08T15:31:18.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14152025-01-08T15:31:18.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14162025-01-08T15:31:18.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14172025-01-08T15:31:18.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14182025-01-08T15:31:18.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14192025-01-08T15:31:18.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14202025-01-08T15:31:18.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14212025-01-08T15:31:18.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14222025-01-08T15:31:18.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14232025-01-08T15:31:18.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14242025-01-08T15:31:18.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14252025-01-08T15:31:18.614ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37442, tv_nsec: 744775679 } })
14262025-01-08T15:31:18.615ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37442, tv_nsec: 744877970 } })
14272025-01-08T15:31:18.615ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14282025-01-08T15:31:18.615ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14292025-01-08T15:31:18.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14302025-01-08T15:31:18.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14312025-01-08T15:31:18.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14322025-01-08T15:31:18.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14332025-01-08T15:31:18.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14342025-01-08T15:31:18.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14352025-01-08T15:31:18.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14362025-01-08T15:31:18.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14372025-01-08T15:31:18.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14382025-01-08T15:31:18.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14392025-01-08T15:31:18.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14402025-01-08T15:31:18.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14412025-01-08T15:31:18.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14422025-01-08T15:31:18.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14432025-01-08T15:31:18.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14442025-01-08T15:31:18.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14452025-01-08T15:31:18.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14462025-01-08T15:31:18.643ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14472025-01-08T15:31:18.643ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14482025-01-08T15:31:18.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14492025-01-08T15:31:18.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14502025-01-08T15:31:18.648ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14512025-01-08T15:31:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14522025-01-08T15:31:18.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.984174ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
14532025-01-08T15:31:18.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.083686ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
14542025-01-08T15:31:18.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14552025-01-08T15:31:18.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14562025-01-08T15:31:18.657ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14572025-01-08T15:31:18.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14582025-01-08T15:31:18.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14592025-01-08T15:31:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14602025-01-08T15:31:18.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14612025-01-08T15:31:18.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 53.335659ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14622025-01-08T15:31:18.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14632025-01-08T15:31:18.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14642025-01-08T15:31:18.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14652025-01-08T15:31:18.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14662025-01-08T15:31:18.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14672025-01-08T15:31:18.664ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14682025-01-08T15:31:18.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14692025-01-08T15:31:18.668ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14702025-01-08T15:31:18.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14712025-01-08T15:31:18.672ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37442, tv_nsec: 802537711 } })
14722025-01-08T15:31:18.673ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
14732025-01-08T15:31:18.684ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14742025-01-08T15:31:18.684ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.12798ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
14752025-01-08T15:31:18.686ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
14762025-01-08T15:31:18.686ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14772025-01-08T15:31:18.687ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca8626d6-f9a3-4621-a204-3fa9014807d8", "content-length": "26", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
14782025-01-08T15:31:18.687ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14792025-01-08T15:31:18.688ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14802025-01-08T15:31:18.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14812025-01-08T15:31:18.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
14822025-01-08T15:31:18.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14832025-01-08T15:31:18.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14842025-01-08T15:31:18.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.355953ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14852025-01-08T15:31:18.705ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
14862025-01-08T15:31:18.705ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.520998ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
14872025-01-08T15:31:18.707ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14882025-01-08T15:31:18.707ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14892025-01-08T15:31:18.707ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14902025-01-08T15:31:18.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14912025-01-08T15:31:18.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14922025-01-08T15:31:18.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ba54f0e2-bde0-4da7-a58e-566dc5903c14, lookup_type: ById(ba54f0e2-bde0-4da7-a58e-566dc5903c14) } result = Ok(())
14932025-01-08T15:31:18.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14942025-01-08T15:31:18.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14952025-01-08T15:31:18.718ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.908567ms iteration = 24 status = 0
14962025-01-08T15:31:18.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.169672ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14972025-01-08T15:31:18.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 134.194104ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14982025-01-08T15:31:18.748ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14992025-01-08T15:31:18.748ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15002025-01-08T15:31:18.748ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.01513ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15012025-01-08T15:31:18.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15022025-01-08T15:31:18.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15032025-01-08T15:31:18.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15042025-01-08T15:31:18.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15052025-01-08T15:31:18.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15062025-01-08T15:31:18.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15072025-01-08T15:31:18.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15082025-01-08T15:31:18.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15092025-01-08T15:31:18.771ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 166.001662ms iteration = 28 status = {"physical_disks_added":0}
15102025-01-08T15:31:18.797ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15112025-01-08T15:31:18.797ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15122025-01-08T15:31:18.797ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "46c8f0c0-d369-44c2-a0b1-1d1262cd6923", "content-length": "26", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15132025-01-08T15:31:18.797ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15142025-01-08T15:31:18.799ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15152025-01-08T15:31:18.815ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15162025-01-08T15:31:18.815ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1565655-beac-47c2-9e82-74ef25091c85", "content-length": "2", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15172025-01-08T15:31:18.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15182025-01-08T15:31:18.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15192025-01-08T15:31:18.824ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 zone_address = fd00:1122:3344:101::2
15202025-01-08T15:31:18.824ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15212025-01-08T15:31:18.824ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b113e9c-8154-47b9-93e2-fb245b89ef04", "content-length": "26", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15222025-01-08T15:31:18.824ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15232025-01-08T15:31:18.826ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
15242025-01-08T15:31:18.844ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15252025-01-08T15:31:18.844ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15262025-01-08T15:31:18.844ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddf96aa9-34fe-476e-ac6f-ad5ac99cb909", "content-length": "372", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15272025-01-08T15:31:18.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15282025-01-08T15:31:18.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15292025-01-08T15:31:18.847ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 242.204539ms iteration = 24 status = null
15302025-01-08T15:31:18.860ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
15312025-01-08T15:31:18.860ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15322025-01-08T15:31:18.860ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "89741242-8764-434b-b7fe-ef22bd4b2f43", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15332025-01-08T15:31:18.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15342025-01-08T15:31:18.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15352025-01-08T15:31:18.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15362025-01-08T15:31:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15372025-01-08T15:31:18.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15382025-01-08T15:31:18.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15392025-01-08T15:31:18.872ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15402025-01-08T15:31:18.872ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15412025-01-08T15:31:18.873ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "da3b1a16-4620-4cc6-8aaf-8d820ea616f8", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15422025-01-08T15:31:18.874ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 269.736487ms iteration = 26 status = {}
15432025-01-08T15:31:18.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15442025-01-08T15:31:18.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15452025-01-08T15:31:18.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15462025-01-08T15:31:18.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15472025-01-08T15:31:18.883ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 278.701045ms iteration = 24 status = {}
15482025-01-08T15:31:18.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1a27fb75-9cb7-4f79-ab2a-a835b542ca1f roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
15492025-01-08T15:31:18.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1a27fb75-9cb7-4f79-ab2a-a835b542ca1f resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
15502025-01-08T15:31:18.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1a27fb75-9cb7-4f79-ab2a-a835b542ca1f response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
15512025-01-08T15:31:18.966ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15522025-01-08T15:31:18.967ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c8c5943-fcb8-426c-b435-d28660f39a95", "content-length": "691", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15532025-01-08T15:31:18.967ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15542025-01-08T15:31:18.967ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
15552025-01-08T15:31:18.967ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
15562025-01-08T15:31:18.969ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 364.303969ms iteration = 25 status = {}
15572025-01-08T15:31:18.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15582025-01-08T15:31:18.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15592025-01-08T15:31:18.994ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c89e6001-fd6e-44a5-b55c-f8de6aa423f5, rack_id: fa7d62e1-57d8-49cc-9dd2-a5f8873ea528, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dc3d148e-05d3-48a7-97ee-42577ccf7e15) } rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0
15602025-01-08T15:31:18.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15612025-01-08T15:31:18.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15622025-01-08T15:31:19.004ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15632025-01-08T15:31:19.004ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fbe96b9-1062-4998-ac1b-d24ff489ec15", "content-length": "134", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15642025-01-08T15:31:19.004ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15652025-01-08T15:31:19.004ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dc3d148e-05d3-48a7-97ee-42577ccf7e15
15662025-01-08T15:31:19.004ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15672025-01-08T15:31:19.004ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15682025-01-08T15:31:19.004ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15692025-01-08T15:31:19.004ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15702025-01-08T15:31:19.004ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15712025-01-08T15:31:19.004ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15722025-01-08T15:31:19.005ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15732025-01-08T15:31:19.005ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15742025-01-08T15:31:19.005ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
15752025-01-08T15:31:19.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15762025-01-08T15:31:19.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15772025-01-08T15:31:19.008ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15782025-01-08T15:31:19.008ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "db00362d-468e-464a-a2f2-a768261eb389", "content-length": "2", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15792025-01-08T15:31:19.008ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15802025-01-08T15:31:19.008ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd4246f7-576f-454d-aef6-a2ce9340bf47", "content-length": "51", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15812025-01-08T15:31:19.008ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0
15822025-01-08T15:31:19.008ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15832025-01-08T15:31:19.178ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "218e0f6c-a7a9-4a03-a50e-56b7606a1562", "date": "Wed, 08 Jan 2025 15:31:18 GMT"} })
15842025-01-08T15:31:19.178ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch = Switch0
15852025-01-08T15:31:19.178ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15862025-01-08T15:31:19.178ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5637c258-cf58-45d5-b860-f53c859005cf", "content-length": "682", "date": "Wed, 08 Jan 2025 15:31:19 GMT"} })
15872025-01-08T15:31:19.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15882025-01-08T15:31:19.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15892025-01-08T15:31:19.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15902025-01-08T15:31:19.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15912025-01-08T15:31:19.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15922025-01-08T15:31:19.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15932025-01-08T15:31:19.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15942025-01-08T15:31:19.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15952025-01-08T15:31:19.196ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 591.475551ms iteration = 24 status = {}
15962025-01-08T15:31:19.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = dbb3ee90-e46d-4b23-9801-ded41d27408e roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
15972025-01-08T15:31:19.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = dbb3ee90-e46d-4b23-9801-ded41d27408e resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
15982025-01-08T15:31:19.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = dbb3ee90-e46d-4b23-9801-ded41d27408e response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
15992025-01-08T15:31:20.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 74d402c9-6bc2-4147-9b8d-e0f6137094f6 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16002025-01-08T15:31:20.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 74d402c9-6bc2-4147-9b8d-e0f6137094f6 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16012025-01-08T15:31:20.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 74d402c9-6bc2-4147-9b8d-e0f6137094f6 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16022025-01-08T15:31:21.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 22725597-cd2f-47dd-8d2f-f4ff2e5f8716 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16032025-01-08T15:31:21.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 22725597-cd2f-47dd-8d2f-f4ff2e5f8716 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16042025-01-08T15:31:21.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 22725597-cd2f-47dd-8d2f-f4ff2e5f8716 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16052025-01-08T15:31:23.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e46ff4b5-0ddd-4a68-9047-2e7868f6b999 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16062025-01-08T15:31:23.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e46ff4b5-0ddd-4a68-9047-2e7868f6b999 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16072025-01-08T15:31:23.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e46ff4b5-0ddd-4a68-9047-2e7868f6b999 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16082025-01-08T15:31:24.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6e7e21ec-8146-4001-9e46-b0bbba0e299a roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16092025-01-08T15:31:24.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6e7e21ec-8146-4001-9e46-b0bbba0e299a resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16102025-01-08T15:31:24.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6e7e21ec-8146-4001-9e46-b0bbba0e299a response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16112025-01-08T15:31:25.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a8224427-4224-4b54-be32-ef665a967af7 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16122025-01-08T15:31:25.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a8224427-4224-4b54-be32-ef665a967af7 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16132025-01-08T15:31:25.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a8224427-4224-4b54-be32-ef665a967af7 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16142025-01-08T15:31:26.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = d216ae17-4fb3-45bc-96fb-eb891fda0103 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16152025-01-08T15:31:26.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = d216ae17-4fb3-45bc-96fb-eb891fda0103 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16162025-01-08T15:31:26.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = d216ae17-4fb3-45bc-96fb-eb891fda0103 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16172025-01-08T15:31:26.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1509 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = da80610b-f56c-4385-855d-24fe64f986ba response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
16182025-01-08T15:31:27.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8b9c6350-c36f-4600-937f-e3f913ecab68 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16192025-01-08T15:31:27.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8b9c6350-c36f-4600-937f-e3f913ecab68 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16202025-01-08T15:31:27.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8b9c6350-c36f-4600-937f-e3f913ecab68 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16212025-01-08T15:31:28.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 11931236-389c-4853-96f9-6dc4c8d73833 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16222025-01-08T15:31:28.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 11931236-389c-4853-96f9-6dc4c8d73833 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16232025-01-08T15:31:28.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 11931236-389c-4853-96f9-6dc4c8d73833 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16242025-01-08T15:31:28.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
16252025-01-08T15:31:28.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16262025-01-08T15:31:28.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
16272025-01-08T15:31:28.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16282025-01-08T15:31:28.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16292025-01-08T15:31:28.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16302025-01-08T15:31:28.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16312025-01-08T15:31:28.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16322025-01-08T15:31:28.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16332025-01-08T15:31:28.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16342025-01-08T15:31:28.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16352025-01-08T15:31:28.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16362025-01-08T15:31:28.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16372025-01-08T15:31:28.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
16382025-01-08T15:31:28.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16392025-01-08T15:31:28.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16402025-01-08T15:31:28.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
16412025-01-08T15:31:28.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.17733ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
16422025-01-08T15:31:28.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16432025-01-08T15:31:28.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16442025-01-08T15:31:28.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.846674ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16452025-01-08T15:31:29.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f415a6ff-2b0f-4865-ad95-02df770033dd roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16462025-01-08T15:31:29.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f415a6ff-2b0f-4865-ad95-02df770033dd resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16472025-01-08T15:31:29.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f415a6ff-2b0f-4865-ad95-02df770033dd response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16482025-01-08T15:31:30.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 23d33eb5-e966-441e-bc0c-a7648cb92d57 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16492025-01-08T15:31:30.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 23d33eb5-e966-441e-bc0c-a7648cb92d57 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16502025-01-08T15:31:30.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 23d33eb5-e966-441e-bc0c-a7648cb92d57 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16512025-01-08T15:31:31.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3a45b9e5-9d59-42c3-9b36-655503e12ff2 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16522025-01-08T15:31:31.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3a45b9e5-9d59-42c3-9b36-655503e12ff2 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16532025-01-08T15:31:31.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 3a45b9e5-9d59-42c3-9b36-655503e12ff2 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16542025-01-08T15:31:32.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7837c8a9-00bc-45d2-a6a0-96e0f740f960 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16552025-01-08T15:31:32.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7837c8a9-00bc-45d2-a6a0-96e0f740f960 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16562025-01-08T15:31:32.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7837c8a9-00bc-45d2-a6a0-96e0f740f960 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16572025-01-08T15:31:33.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c0549dfb-7f62-4221-ac45-0e431c887de0 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16582025-01-08T15:31:33.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c0549dfb-7f62-4221-ac45-0e431c887de0 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16592025-01-08T15:31:33.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c0549dfb-7f62-4221-ac45-0e431c887de0 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16602025-01-08T15:31:34.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1fadec7e-3078-4218-bce6-c4d0168078a5 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16612025-01-08T15:31:34.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1fadec7e-3078-4218-bce6-c4d0168078a5 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16622025-01-08T15:31:34.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1fadec7e-3078-4218-bce6-c4d0168078a5 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16632025-01-08T15:31:34.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 1b188442-ae86-461f-801a-62ba42cd4e01 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
16642025-01-08T15:31:34.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 1b188442-ae86-461f-801a-62ba42cd4e01 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
16652025-01-08T15:31:34.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 1b188442-ae86-461f-801a-62ba42cd4e01 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
16662025-01-08T15:31:35.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = bd62b0fb-917a-40dc-9fa3-4c1a03822bcf roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16672025-01-08T15:31:35.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = bd62b0fb-917a-40dc-9fa3-4c1a03822bcf resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16682025-01-08T15:31:35.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = bd62b0fb-917a-40dc-9fa3-4c1a03822bcf response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16692025-01-08T15:31:36.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6d37bfa9-6b31-470b-a098-a3fb2b15f134 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16702025-01-08T15:31:36.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6d37bfa9-6b31-470b-a098-a3fb2b15f134 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16712025-01-08T15:31:36.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6d37bfa9-6b31-470b-a098-a3fb2b15f134 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16722025-01-08T15:31:36.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 8b7e5826-cda9-48ac-99d5-a2372b75145d roles = RoleSet { roles: {} } uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?sort_by=id_ascending
16732025-01-08T15:31:36.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 8b7e5826-cda9-48ac-99d5-a2372b75145d resource = Database result = Ok(()) uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?sort_by=id_ascending
16742025-01-08T15:31:36.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 8b7e5826-cda9-48ac-99d5-a2372b75145d response_code = 200 uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?sort_by=id_ascending
16752025-01-08T15:31:36.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = cded7139-51bd-47f2-a492-bfacc391f166 roles = RoleSet { roles: {} } uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDIxMTVkNi04NWEzLTQwNmItYmY4Mi0zMGYzNDFkZGU4YjgifX0%3D
16762025-01-08T15:31:36.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = cded7139-51bd-47f2-a492-bfacc391f166 resource = Database result = Ok(()) uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDIxMTVkNi04NWEzLTQwNmItYmY4Mi0zMGYzNDFkZGU4YjgifX0%3D
16772025-01-08T15:31:36.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = cded7139-51bd-47f2-a492-bfacc391f166 response_code = 200 uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDIxMTVkNi04NWEzLTQwNmItYmY4Mi0zMGYzNDFkZGU4YjgifX0%3D
16782025-01-08T15:31:36.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1297 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = 031bbda3-6735-46ac-bdf8-ba73507f9f19 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
16792025-01-08T15:31:37.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e2c88dc3-dad2-4ef9-852a-b8f6b96bb202 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16802025-01-08T15:31:37.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e2c88dc3-dad2-4ef9-852a-b8f6b96bb202 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16812025-01-08T15:31:37.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e2c88dc3-dad2-4ef9-852a-b8f6b96bb202 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16822025-01-08T15:31:38.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 0a089af3-ddcf-4ddd-8ad6-38300c61402f roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16832025-01-08T15:31:38.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 0a089af3-ddcf-4ddd-8ad6-38300c61402f resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16842025-01-08T15:31:38.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 0a089af3-ddcf-4ddd-8ad6-38300c61402f response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
16852025-01-08T15:31:38.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
16862025-01-08T15:31:38.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16872025-01-08T15:31:38.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
16882025-01-08T15:31:38.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16892025-01-08T15:31:38.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16902025-01-08T15:31:38.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16912025-01-08T15:31:38.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16922025-01-08T15:31:38.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16932025-01-08T15:31:38.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16942025-01-08T15:31:38.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16952025-01-08T15:31:38.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16962025-01-08T15:31:38.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16972025-01-08T15:31:38.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16982025-01-08T15:31:38.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16992025-01-08T15:31:38.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17002025-01-08T15:31:38.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
17012025-01-08T15:31:38.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17022025-01-08T15:31:38.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17032025-01-08T15:31:38.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
17042025-01-08T15:31:38.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.432104ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
17052025-01-08T15:31:38.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.664056ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17062025-01-08T15:31:39.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 729d4cad-514b-47b1-91d3-d320514e599c roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17072025-01-08T15:31:39.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 729d4cad-514b-47b1-91d3-d320514e599c resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17082025-01-08T15:31:39.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 729d4cad-514b-47b1-91d3-d320514e599c response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17092025-01-08T15:31:40.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8b1e4e86-9384-4a6e-884f-e2a433db60be roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17102025-01-08T15:31:40.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8b1e4e86-9384-4a6e-884f-e2a433db60be resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17112025-01-08T15:31:40.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8b1e4e86-9384-4a6e-884f-e2a433db60be response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17122025-01-08T15:31:41.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = dca2b97b-9676-48ed-90db-169e19d22ddd roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17132025-01-08T15:31:41.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = dca2b97b-9676-48ed-90db-169e19d22ddd resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17142025-01-08T15:31:41.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = dca2b97b-9676-48ed-90db-169e19d22ddd response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17152025-01-08T15:31:42.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4aa3ffe8-ec5b-4a40-af0e-03fa5778411e roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17162025-01-08T15:31:42.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4aa3ffe8-ec5b-4a40-af0e-03fa5778411e resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17172025-01-08T15:31:42.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4aa3ffe8-ec5b-4a40-af0e-03fa5778411e response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17182025-01-08T15:31:43.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a9411901-1c96-4a32-a7c7-abc0d8ee8bb2 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17192025-01-08T15:31:43.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a9411901-1c96-4a32-a7c7-abc0d8ee8bb2 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17202025-01-08T15:31:43.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a9411901-1c96-4a32-a7c7-abc0d8ee8bb2 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17212025-01-08T15:31:44.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 83610779-2525-48eb-adfd-570b34fb0d0e roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17222025-01-08T15:31:44.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 83610779-2525-48eb-adfd-570b34fb0d0e resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17232025-01-08T15:31:44.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 83610779-2525-48eb-adfd-570b34fb0d0e response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17242025-01-08T15:31:45.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 9e523f41-4244-45d6-9a9e-56ab42efdc46 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17252025-01-08T15:31:45.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 9e523f41-4244-45d6-9a9e-56ab42efdc46 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17262025-01-08T15:31:45.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 9e523f41-4244-45d6-9a9e-56ab42efdc46 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17272025-01-08T15:31:46.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cd5ad7cb-6bb7-4b1c-94e9-5edb053a66f2 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17282025-01-08T15:31:46.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cd5ad7cb-6bb7-4b1c-94e9-5edb053a66f2 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17292025-01-08T15:31:46.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cd5ad7cb-6bb7-4b1c-94e9-5edb053a66f2 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17302025-01-08T15:31:46.786ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1395 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = 95592eee-5f93-4119-807c-234c89960624 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
17312025-01-08T15:31:47.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 06b6b4b1-e372-4d65-b146-469fa4ed6dc8 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17322025-01-08T15:31:47.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 06b6b4b1-e372-4d65-b146-469fa4ed6dc8 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17332025-01-08T15:31:47.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 06b6b4b1-e372-4d65-b146-469fa4ed6dc8 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17342025-01-08T15:31:48.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8583fd18-c9f5-4306-a656-3c9bce8dee91 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17352025-01-08T15:31:48.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8583fd18-c9f5-4306-a656-3c9bce8dee91 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17362025-01-08T15:31:48.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8583fd18-c9f5-4306-a656-3c9bce8dee91 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
17372025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
17382025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
17392025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
17402025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17412025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
17422025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17432025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17442025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17452025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
17462025-01-08T15:31:48.605ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
17472025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17482025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
17492025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
17502025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17512025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
17522025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17532025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17542025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17552025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
17562025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17572025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
17582025-01-08T15:31:48.605ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17592025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
17602025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17612025-01-08T15:31:48.605ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f
17622025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.9\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f"}
17632025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
17642025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
17652025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17662025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17672025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
17682025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17692025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
17702025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17712025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
17722025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17732025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
17742025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
17752025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
17762025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
17772025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
17782025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
17792025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17802025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
17812025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17822025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
17832025-01-08T15:31:48.605ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-08 15:21:48.605386956 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
17842025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
17852025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
17862025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
17872025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17882025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17892025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17902025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17912025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17922025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17932025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17942025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17952025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17962025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17972025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17982025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17992025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18002025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18012025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18022025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18032025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18042025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18052025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18062025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18072025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
18082025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18092025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
18102025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18112025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
18122025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
18132025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
18142025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18152025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
18162025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18172025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
18182025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18192025-01-08T15:31:48.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18202025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
18212025-01-08T15:31:48.606ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4ac9516f-ce2b-441e-b6e1-c7e068dc9b60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("546529ac-9cd3-4187-a253-14c651454456.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("546529ac-9cd3-4187-a253-14c651454456.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 37472, tv_nsec: 735775119 } })
18222025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18232025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18242025-01-08T15:31:48.606ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd3e994a-ca27-4475-b826-d1843113ddee.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c83545e9-4211-4dca-9ec0-0f110abfca92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea871c24-fe68-43ce-af24-67c6f74ea37d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea871c24-fe68-43ce-af24-67c6f74ea37d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 37472, tv_nsec: 735933871 } })
18252025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18262025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18272025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18282025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18292025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18302025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18312025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18322025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18332025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
18342025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.160017ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
18352025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18362025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18372025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
18382025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18392025-01-08T15:31:48.606ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.362869ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
18402025-01-08T15:31:48.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18412025-01-08T15:31:48.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18422025-01-08T15:31:48.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18432025-01-08T15:31:48.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18442025-01-08T15:31:48.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18452025-01-08T15:31:48.609ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.693994ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18462025-01-08T15:31:48.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18472025-01-08T15:31:48.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18482025-01-08T15:31:48.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18492025-01-08T15:31:48.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18502025-01-08T15:31:48.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18512025-01-08T15:31:48.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18522025-01-08T15:31:48.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18532025-01-08T15:31:48.612ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18542025-01-08T15:31:48.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18552025-01-08T15:31:48.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18562025-01-08T15:31:48.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18572025-01-08T15:31:48.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18582025-01-08T15:31:48.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18592025-01-08T15:31:48.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18602025-01-08T15:31:48.614ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37472, tv_nsec: 743749374 } })
18612025-01-08T15:31:48.614ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
18622025-01-08T15:31:48.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18632025-01-08T15:31:48.614ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18642025-01-08T15:31:48.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18652025-01-08T15:31:48.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18662025-01-08T15:31:48.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18672025-01-08T15:31:48.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18682025-01-08T15:31:48.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18692025-01-08T15:31:48.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18702025-01-08T15:31:48.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18712025-01-08T15:31:48.618ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18722025-01-08T15:31:48.618ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18732025-01-08T15:31:48.620ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-08 15:21:48.605386956 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18742025-01-08T15:31:48.620ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.140888ms iteration = 13 status = {"expiration":"2025-01-08T15:21:48.605386956Z","pruned":[]}
18752025-01-08T15:31:48.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18762025-01-08T15:31:48.620ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18772025-01-08T15:31:48.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18782025-01-08T15:31:48.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18792025-01-08T15:31:48.621ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18802025-01-08T15:31:48.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18812025-01-08T15:31:48.623ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37472, tv_nsec: 752965607 } })
18822025-01-08T15:31:48.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18832025-01-08T15:31:48.624ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.465966ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
18842025-01-08T15:31:48.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18852025-01-08T15:31:48.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18862025-01-08T15:31:48.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18872025-01-08T15:31:48.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18882025-01-08T15:31:48.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18892025-01-08T15:31:48.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18902025-01-08T15:31:48.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18912025-01-08T15:31:48.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18922025-01-08T15:31:48.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18932025-01-08T15:31:48.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18942025-01-08T15:31:48.632ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18952025-01-08T15:31:48.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18962025-01-08T15:31:48.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18972025-01-08T15:31:48.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18982025-01-08T15:31:48.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18992025-01-08T15:31:48.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19002025-01-08T15:31:48.638ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37472, tv_nsec: 768418319 } })
19012025-01-08T15:31:48.639ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
19022025-01-08T15:31:48.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19032025-01-08T15:31:48.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19042025-01-08T15:31:48.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19052025-01-08T15:31:48.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19062025-01-08T15:31:48.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19072025-01-08T15:31:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19082025-01-08T15:31:48.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19092025-01-08T15:31:48.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
19102025-01-08T15:31:48.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19112025-01-08T15:31:48.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19122025-01-08T15:31:48.652ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19132025-01-08T15:31:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19142025-01-08T15:31:48.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19152025-01-08T15:31:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19162025-01-08T15:31:48.658ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19172025-01-08T15:31:48.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19182025-01-08T15:31:48.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19192025-01-08T15:31:48.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19202025-01-08T15:31:48.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19212025-01-08T15:31:48.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19222025-01-08T15:31:48.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19232025-01-08T15:31:48.671ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19242025-01-08T15:31:48.671ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19252025-01-08T15:31:48.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19262025-01-08T15:31:48.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19272025-01-08T15:31:48.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19282025-01-08T15:31:48.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19292025-01-08T15:31:48.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19302025-01-08T15:31:48.673ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19312025-01-08T15:31:48.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19322025-01-08T15:31:48.674ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
19332025-01-08T15:31:48.674ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
19342025-01-08T15:31:48.674ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 68.451136ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
19352025-01-08T15:31:48.675ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362025-01-08T15:31:48.677ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19372025-01-08T15:31:48.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19382025-01-08T15:31:48.677ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.875446ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
19392025-01-08T15:31:48.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19402025-01-08T15:31:48.678ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19412025-01-08T15:31:48.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19422025-01-08T15:31:48.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.250389ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
19432025-01-08T15:31:48.685ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19442025-01-08T15:31:48.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19452025-01-08T15:31:48.688ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19462025-01-08T15:31:48.688ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19472025-01-08T15:31:48.688ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19482025-01-08T15:31:48.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19492025-01-08T15:31:48.688ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19502025-01-08T15:31:48.688ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19512025-01-08T15:31:48.688ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.26622ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19522025-01-08T15:31:48.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19532025-01-08T15:31:48.690ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19542025-01-08T15:31:48.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19552025-01-08T15:31:48.693ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19562025-01-08T15:31:48.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19572025-01-08T15:31:48.694ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19582025-01-08T15:31:48.694ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19592025-01-08T15:31:48.694ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19602025-01-08T15:31:48.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19612025-01-08T15:31:48.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19622025-01-08T15:31:48.696ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
19632025-01-08T15:31:48.696ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.760292ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
19642025-01-08T15:31:48.698ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 93.377775ms iteration = 6 status = {"nsuccess":5}
19652025-01-08T15:31:48.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19662025-01-08T15:31:48.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19672025-01-08T15:31:48.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19682025-01-08T15:31:48.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19692025-01-08T15:31:48.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702025-01-08T15:31:48.709ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
19712025-01-08T15:31:48.709ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d1ec779f-5a73-494d-b0a9-290833d170fb dns_zone_name = oxide.test found_so_far = 0 version = 2
19722025-01-08T15:31:48.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19732025-01-08T15:31:48.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19742025-01-08T15:31:48.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19752025-01-08T15:31:48.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19762025-01-08T15:31:48.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19772025-01-08T15:31:48.711ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.701983ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19782025-01-08T15:31:48.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19792025-01-08T15:31:48.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19802025-01-08T15:31:48.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19812025-01-08T15:31:48.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19822025-01-08T15:31:48.716ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19832025-01-08T15:31:48.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19842025-01-08T15:31:48.718ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d1ec779f-5a73-494d-b0a9-290833d170fb dns_zone_name = oxide.test found_so_far = 1 version = 2
19852025-01-08T15:31:48.718ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19862025-01-08T15:31:48.718ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-08 15:20:20.232169 UTC dns_group = external generation = 2
19872025-01-08T15:31:48.718ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 113.10877ms iteration = 14 status = {"generation":2}
19882025-01-08T15:31:48.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19892025-01-08T15:31:48.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19902025-01-08T15:31:48.723ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19912025-01-08T15:31:48.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19922025-01-08T15:31:48.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19932025-01-08T15:31:48.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19942025-01-08T15:31:48.728ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19952025-01-08T15:31:48.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19962025-01-08T15:31:48.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19972025-01-08T15:31:48.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19982025-01-08T15:31:48.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19992025-01-08T15:31:48.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ba54f0e2-bde0-4da7-a58e-566dc5903c14, lookup_type: ById(ba54f0e2-bde0-4da7-a58e-566dc5903c14) } result = Ok(())
20002025-01-08T15:31:48.734ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20012025-01-08T15:31:48.734ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 129.683099ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20022025-01-08T15:31:48.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20032025-01-08T15:31:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20042025-01-08T15:31:48.737ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 131.88906ms iteration = 25 status = 0
20052025-01-08T15:31:48.742ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.031084ms iteration = 29 status = {"physical_disks_added":0}
20062025-01-08T15:31:48.743ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20072025-01-08T15:31:48.743ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20082025-01-08T15:31:48.743ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20092025-01-08T15:31:48.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20102025-01-08T15:31:48.743ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.854346ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
20112025-01-08T15:31:48.746ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 141.271435ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20122025-01-08T15:31:48.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20132025-01-08T15:31:48.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 150.421057ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20142025-01-08T15:31:48.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20152025-01-08T15:31:48.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20162025-01-08T15:31:48.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20172025-01-08T15:31:48.759ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20182025-01-08T15:31:48.759ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f8792d26-cdc7-40a4-9573-1d15840c2466 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20192025-01-08T15:31:48.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20202025-01-08T15:31:48.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20212025-01-08T15:31:48.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20222025-01-08T15:31:48.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20232025-01-08T15:31:48.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20242025-01-08T15:31:48.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20252025-01-08T15:31:48.767ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f8792d26-cdc7-40a4-9573-1d15840c2466 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
20262025-01-08T15:31:48.767ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20272025-01-08T15:31:48.767ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-08 15:20:19.495429 UTC dns_group = internal generation = 1
20282025-01-08T15:31:48.767ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 162.336869ms iteration = 14 status = {"generation":1}
20292025-01-08T15:31:48.773ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
20302025-01-08T15:31:48.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20312025-01-08T15:31:48.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20322025-01-08T15:31:48.784ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20332025-01-08T15:31:48.784ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20342025-01-08T15:31:48.784ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 179.523277ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20352025-01-08T15:31:48.787ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20362025-01-08T15:31:48.787ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20372025-01-08T15:31:48.787ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9177a7f5-4d69-4c42-afa1-d97c67c1e5a9", "content-length": "26", "date": "Wed, 08 Jan 2025 15:31:48 GMT"} })
20382025-01-08T15:31:48.787ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20392025-01-08T15:31:48.792ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20402025-01-08T15:31:48.796ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-08T15:19:45.145737Z, time_modified: 2025-01-08T15:19:45.145737Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: af729a51-87ee-4946-b919-b2c335114c91, db_silo: Silo { identity: SiloIdentity { id: af729a51-87ee-4946-b919-b2c335114c91, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-08T15:20:20.181122Z, time_modified: 2025-01-08T15:20:20.181122Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ca6ed1c164ca4828050a33061c1eba4440262a3fb9d99fdb07abd3987dfdf513" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: af729a51-87ee-4946-b919-b2c335114c91, db_silo: Silo { identity: SiloIdentity { id: af729a51-87ee-4946-b919-b2c335114c91, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-08T15:20:20.181122Z, time_modified: 2025-01-08T15:20:20.181122Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ca6ed1c164ca4828050a33061c1eba4440262a3fb9d99fdb07abd3987dfdf513" }] }) }
20412025-01-08T15:31:48.796ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 191.087193ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"af729a51-87ee-4946-b919-b2c335114c91","tls_certs":["ca6ed1c164ca4828050a33061c1eba4440262a3fb9d99fdb07abd3987dfdf513"]}},"default_endpoint":{"silo_id":"af729a51-87ee-4946-b919-b2c335114c91","tls_certs":["ca6ed1c164ca4828050a33061c1eba4440262a3fb9d99fdb07abd3987dfdf513"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20422025-01-08T15:31:48.800ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20432025-01-08T15:31:48.800ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20442025-01-08T15:31:48.800ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40afd7ef-9184-40a6-aae0-b7d4363172b3", "content-length": "26", "date": "Wed, 08 Jan 2025 15:31:48 GMT"} })
20452025-01-08T15:31:48.800ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20462025-01-08T15:31:48.802ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20472025-01-08T15:31:48.836ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
20482025-01-08T15:31:48.836ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 231.668558ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20492025-01-08T15:31:48.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20502025-01-08T15:31:48.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20512025-01-08T15:31:48.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20522025-01-08T15:31:48.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20532025-01-08T15:31:48.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20542025-01-08T15:31:48.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20552025-01-08T15:31:48.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20562025-01-08T15:31:48.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20572025-01-08T15:31:48.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20582025-01-08T15:31:48.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20592025-01-08T15:31:48.866ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
20602025-01-08T15:31:48.996ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 zone_address = fd00:1122:3344:101::2
20612025-01-08T15:31:48.996ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20622025-01-08T15:31:48.996ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ac1e765-786a-4916-bf00-46671b1de0e2", "content-length": "26", "date": "Wed, 08 Jan 2025 15:31:48 GMT"} })
20632025-01-08T15:31:48.996ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20642025-01-08T15:31:48.998ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
20652025-01-08T15:31:48.998ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20662025-01-08T15:31:48.998ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "950f52ff-d836-4d9b-a6a2-fc9cf4381df5", "content-length": "2", "date": "Wed, 08 Jan 2025 15:31:48 GMT"} })
20672025-01-08T15:31:49.000ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20682025-01-08T15:31:49.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20692025-01-08T15:31:49.052ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20702025-01-08T15:31:49.052ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20712025-01-08T15:31:49.053ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b58246a4-cca6-4848-a6f3-39e6a2c238c9", "content-length": "372", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} })
20722025-01-08T15:31:49.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20732025-01-08T15:31:49.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20742025-01-08T15:31:49.055ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 450.233547ms iteration = 25 status = null
20752025-01-08T15:31:49.068ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20762025-01-08T15:31:49.068ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20772025-01-08T15:31:49.068ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a13ede53-f3dd-4477-85b0-0bfe8486d877", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} })
20782025-01-08T15:31:49.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20792025-01-08T15:31:49.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20802025-01-08T15:31:49.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20812025-01-08T15:31:49.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20822025-01-08T15:31:49.091ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
20832025-01-08T15:31:49.096ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20842025-01-08T15:31:49.097ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "014c0369-2121-4803-9904-c86f163b6201", "content-length": "691", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} })
20852025-01-08T15:31:49.097ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20862025-01-08T15:31:49.097ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20872025-01-08T15:31:49.097ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20882025-01-08T15:31:49.099ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.888956ms iteration = 26 status = {}
20892025-01-08T15:31:49.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20902025-01-08T15:31:49.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20912025-01-08T15:31:49.103ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20922025-01-08T15:31:49.103ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20932025-01-08T15:31:49.103ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "74ea061e-6eb4-469e-82a4-50c8b6f8a9fb", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} })
20942025-01-08T15:31:49.105ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 500.517812ms iteration = 27 status = {}
20952025-01-08T15:31:49.121ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
20962025-01-08T15:31:49.121ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ec945190-69d2-4d63-8fea-4ca2ae92a6a3", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20972025-01-08T15:31:49.121ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20982025-01-08T15:31:49.123ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b2efd5e2-d9c2-466e-aa8b-49082cee4682", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20992025-01-08T15:31:49.123ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21002025-01-08T15:31:49.125ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21012025-01-08T15:31:49.125ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 520.402638ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
21022025-01-08T15:31:49.130ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 525.327819ms iteration = 25 status = {}
21032025-01-08T15:31:49.152ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
21042025-01-08T15:31:49.153ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "291fac65-adc9-4840-8836-6dd77fe61746", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21052025-01-08T15:31:49.153ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21062025-01-08T15:31:49.154ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6047a9fe-375f-47dc-aace-a87e909960b4", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21072025-01-08T15:31:49.154ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21082025-01-08T15:31:49.157ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7b464e06-e310-4a03-922a-4fa732882a07", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21092025-01-08T15:31:49.157ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21102025-01-08T15:31:49.159ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21112025-01-08T15:31:49.159ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 554.134264ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
21122025-01-08T15:31:49.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21132025-01-08T15:31:49.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21142025-01-08T15:31:49.207ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c89e6001-fd6e-44a5-b55c-f8de6aa423f5, rack_id: fa7d62e1-57d8-49cc-9dd2-a5f8873ea528, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dc3d148e-05d3-48a7-97ee-42577ccf7e15) } rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0
21152025-01-08T15:31:49.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21162025-01-08T15:31:49.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21172025-01-08T15:31:49.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21182025-01-08T15:31:49.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0f3a52d-1599-4b26-8281-b6f81d73300e", "content-length": "134", "date": "Wed, 08 Jan 2025 15:31:48 GMT"} })
21192025-01-08T15:31:49.217ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21202025-01-08T15:31:49.217ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dc3d148e-05d3-48a7-97ee-42577ccf7e15
21212025-01-08T15:31:49.218ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21222025-01-08T15:31:49.218ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21232025-01-08T15:31:49.218ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21242025-01-08T15:31:49.218ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21252025-01-08T15:31:49.218ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21262025-01-08T15:31:49.218ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21272025-01-08T15:31:49.218ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21282025-01-08T15:31:49.218ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21292025-01-08T15:31:49.218ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
21302025-01-08T15:31:49.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21312025-01-08T15:31:49.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21322025-01-08T15:31:49.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21332025-01-08T15:31:49.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a82c751-49c5-433c-9513-a05f45783069", "content-length": "2", "date": "Wed, 08 Jan 2025 15:31:48 GMT"} })
21342025-01-08T15:31:49.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21352025-01-08T15:31:49.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f315d005-8836-4a08-b272-9679e20315b5", "content-length": "51", "date": "Wed, 08 Jan 2025 15:31:48 GMT"} })
21362025-01-08T15:31:49.220ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0
21372025-01-08T15:31:49.220ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21382025-01-08T15:31:49.397ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "510b35d2-18ef-400e-ad0e-443130baed27", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} })
21392025-01-08T15:31:49.397ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch = Switch0
21402025-01-08T15:31:49.397ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21412025-01-08T15:31:49.402ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "04747ef5-220d-4d2c-8eb0-11163c760ae4", "content-length": "682", "date": "Wed, 08 Jan 2025 15:31:49 GMT"} })
21422025-01-08T15:31:49.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21432025-01-08T15:31:49.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21442025-01-08T15:31:49.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21452025-01-08T15:31:49.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21462025-01-08T15:31:49.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21472025-01-08T15:31:49.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21482025-01-08T15:31:49.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21492025-01-08T15:31:49.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21502025-01-08T15:31:49.419ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 814.527665ms iteration = 25 status = {}
21512025-01-08T15:31:49.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7473c4bb-f6d7-40a5-9e93-186c9b2704bd roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21522025-01-08T15:31:49.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7473c4bb-f6d7-40a5-9e93-186c9b2704bd resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21532025-01-08T15:31:49.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7473c4bb-f6d7-40a5-9e93-186c9b2704bd response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21542025-01-08T15:31:50.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2bf2e05f-05d1-406a-91cf-843468b26573 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21552025-01-08T15:31:50.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2bf2e05f-05d1-406a-91cf-843468b26573 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21562025-01-08T15:31:50.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2bf2e05f-05d1-406a-91cf-843468b26573 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21572025-01-08T15:31:51.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a1b1fb3a-224a-4d2c-b7ca-a9bef8f57492 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21582025-01-08T15:31:51.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a1b1fb3a-224a-4d2c-b7ca-a9bef8f57492 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21592025-01-08T15:31:51.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a1b1fb3a-224a-4d2c-b7ca-a9bef8f57492 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21602025-01-08T15:31:52.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a270ca43-48d7-4181-a889-947232318e33 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21612025-01-08T15:31:52.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a270ca43-48d7-4181-a889-947232318e33 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21622025-01-08T15:31:52.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a270ca43-48d7-4181-a889-947232318e33 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21632025-01-08T15:31:53.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 135a7af5-4ff7-4ce9-930c-0fdb79bcad60 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21642025-01-08T15:31:53.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 135a7af5-4ff7-4ce9-930c-0fdb79bcad60 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21652025-01-08T15:31:53.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 135a7af5-4ff7-4ce9-930c-0fdb79bcad60 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21662025-01-08T15:31:54.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fc391ac6-26b1-4fa7-bc0a-f231b293ab00 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21672025-01-08T15:31:54.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fc391ac6-26b1-4fa7-bc0a-f231b293ab00 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21682025-01-08T15:31:54.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = fc391ac6-26b1-4fa7-bc0a-f231b293ab00 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21692025-01-08T15:31:55.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e636b046-2033-459e-9575-db1a09983f52 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21702025-01-08T15:31:55.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e636b046-2033-459e-9575-db1a09983f52 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21712025-01-08T15:31:55.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e636b046-2033-459e-9575-db1a09983f52 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21722025-01-08T15:31:56.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 59a79570-92ef-48b9-b1fc-2e842d5487ba roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21732025-01-08T15:31:56.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 59a79570-92ef-48b9-b1fc-2e842d5487ba resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21742025-01-08T15:31:56.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 59a79570-92ef-48b9-b1fc-2e842d5487ba response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21752025-01-08T15:31:56.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1403 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = 45774048-ac7c-43bf-b94d-b7774bb2f859 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
21762025-01-08T15:31:57.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7cb121ee-a1e2-40a5-83da-3988b17f531e roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21772025-01-08T15:31:57.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7cb121ee-a1e2-40a5-83da-3988b17f531e resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21782025-01-08T15:31:57.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 7cb121ee-a1e2-40a5-83da-3988b17f531e response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
21792025-01-08T15:31:58.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
21802025-01-08T15:31:58.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
21812025-01-08T15:31:58.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21822025-01-08T15:31:58.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21832025-01-08T15:31:58.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21842025-01-08T15:31:58.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21852025-01-08T15:31:58.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21862025-01-08T15:31:58.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21872025-01-08T15:31:58.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21882025-01-08T15:31:58.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.414504ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21892025-01-08T15:31:58.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21902025-01-08T15:31:58.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21912025-01-08T15:31:58.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21922025-01-08T15:31:58.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21932025-01-08T15:31:58.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21942025-01-08T15:31:58.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21952025-01-08T15:31:58.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
21962025-01-08T15:31:58.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21972025-01-08T15:31:58.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21982025-01-08T15:31:58.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
21992025-01-08T15:31:58.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.244781ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
22002025-01-08T15:31:58.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 5eeba0ac-1306-4247-a696-a59f2402d81e roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22012025-01-08T15:31:58.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 5eeba0ac-1306-4247-a696-a59f2402d81e resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22022025-01-08T15:31:58.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 5eeba0ac-1306-4247-a696-a59f2402d81e response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22032025-01-08T15:31:59.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8b790a03-8e2d-436c-b6e3-ad966f9f3dae roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22042025-01-08T15:31:59.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8b790a03-8e2d-436c-b6e3-ad966f9f3dae resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22052025-01-08T15:31:59.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 8b790a03-8e2d-436c-b6e3-ad966f9f3dae response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22062025-01-08T15:32:00.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = bbabb0cb-e937-45f8-a77a-4ade0950d306 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22072025-01-08T15:32:00.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = bbabb0cb-e937-45f8-a77a-4ade0950d306 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22082025-01-08T15:32:00.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = bbabb0cb-e937-45f8-a77a-4ade0950d306 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22092025-01-08T15:32:01.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b48ce63b-2c10-461f-9ded-8cc32cea394b roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22102025-01-08T15:32:01.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b48ce63b-2c10-461f-9ded-8cc32cea394b resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22112025-01-08T15:32:01.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b48ce63b-2c10-461f-9ded-8cc32cea394b response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22122025-01-08T15:32:02.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f543a260-bbc7-4aae-9760-63fb2214c1e3 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22132025-01-08T15:32:02.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f543a260-bbc7-4aae-9760-63fb2214c1e3 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22142025-01-08T15:32:02.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f543a260-bbc7-4aae-9760-63fb2214c1e3 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22152025-01-08T15:32:03.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2e887080-c0a9-42c9-875a-1db9e57f310d roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22162025-01-08T15:32:03.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2e887080-c0a9-42c9-875a-1db9e57f310d resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22172025-01-08T15:32:03.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2e887080-c0a9-42c9-875a-1db9e57f310d response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22182025-01-08T15:32:04.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 561e6a5c-4af5-4d21-bd3b-a8fcf6456140 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22192025-01-08T15:32:04.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 561e6a5c-4af5-4d21-bd3b-a8fcf6456140 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22202025-01-08T15:32:04.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 686f8b14-30f8-4b89-92e8-17d19cf8deed roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
22212025-01-08T15:32:04.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 686f8b14-30f8-4b89-92e8-17d19cf8deed resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
22222025-01-08T15:32:04.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 561e6a5c-4af5-4d21-bd3b-a8fcf6456140 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22232025-01-08T15:32:04.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 686f8b14-30f8-4b89-92e8-17d19cf8deed response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
22242025-01-08T15:32:05.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1948b269-757d-4a56-83d9-726c1d469648 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22252025-01-08T15:32:05.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1948b269-757d-4a56-83d9-726c1d469648 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22262025-01-08T15:32:05.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1948b269-757d-4a56-83d9-726c1d469648 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22272025-01-08T15:32:06.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1379 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = c3f4d5c9-e822-4536-8892-41d890667345 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
22282025-01-08T15:32:06.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1e83cc9c-fe90-482f-8e1d-73ad8e5ef9dd roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22292025-01-08T15:32:06.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1e83cc9c-fe90-482f-8e1d-73ad8e5ef9dd resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22302025-01-08T15:32:06.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1e83cc9c-fe90-482f-8e1d-73ad8e5ef9dd response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22312025-01-08T15:32:07.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b2342fc1-67f1-42ce-abc7-8cfdf91953c7 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22322025-01-08T15:32:07.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b2342fc1-67f1-42ce-abc7-8cfdf91953c7 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22332025-01-08T15:32:07.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b2342fc1-67f1-42ce-abc7-8cfdf91953c7 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22342025-01-08T15:32:08.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
22352025-01-08T15:32:08.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22362025-01-08T15:32:08.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
22372025-01-08T15:32:08.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22382025-01-08T15:32:08.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22392025-01-08T15:32:08.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22402025-01-08T15:32:08.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22412025-01-08T15:32:08.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22422025-01-08T15:32:08.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22432025-01-08T15:32:08.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22442025-01-08T15:32:08.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22452025-01-08T15:32:08.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22462025-01-08T15:32:08.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22472025-01-08T15:32:08.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22482025-01-08T15:32:08.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22492025-01-08T15:32:08.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
22502025-01-08T15:32:08.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22512025-01-08T15:32:08.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22522025-01-08T15:32:08.630ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
22532025-01-08T15:32:08.630ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.316504ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
22542025-01-08T15:32:08.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.451036ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22552025-01-08T15:32:08.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a02bf6ff-6589-43e5-8e25-1b9a6b1074da roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22562025-01-08T15:32:08.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a02bf6ff-6589-43e5-8e25-1b9a6b1074da resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22572025-01-08T15:32:09.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = a02bf6ff-6589-43e5-8e25-1b9a6b1074da response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22582025-01-08T15:32:10.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cf9a3adf-f32c-41ac-ab09-fb6f7a05327b roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22592025-01-08T15:32:10.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cf9a3adf-f32c-41ac-ab09-fb6f7a05327b resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22602025-01-08T15:32:10.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = cf9a3adf-f32c-41ac-ab09-fb6f7a05327b response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22612025-01-08T15:32:11.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 02f43928-24bd-4bae-9845-13ea86be99d6 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22622025-01-08T15:32:11.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 02f43928-24bd-4bae-9845-13ea86be99d6 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22632025-01-08T15:32:11.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 02f43928-24bd-4bae-9845-13ea86be99d6 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22642025-01-08T15:32:12.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 40838c01-6e68-4aad-859a-8a86a76ee970 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22652025-01-08T15:32:12.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 40838c01-6e68-4aad-859a-8a86a76ee970 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22662025-01-08T15:32:12.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 40838c01-6e68-4aad-859a-8a86a76ee970 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22672025-01-08T15:32:13.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b0b87722-b024-4b8a-bf18-a9ccc0393c99 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22682025-01-08T15:32:13.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b0b87722-b024-4b8a-bf18-a9ccc0393c99 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22692025-01-08T15:32:13.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = b0b87722-b024-4b8a-bf18-a9ccc0393c99 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22702025-01-08T15:32:14.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 99782254-1a03-4a5e-a585-de92a3dc8c60 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22712025-01-08T15:32:14.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 99782254-1a03-4a5e-a585-de92a3dc8c60 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22722025-01-08T15:32:14.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 99782254-1a03-4a5e-a585-de92a3dc8c60 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22732025-01-08T15:32:15.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 99a3e4e8-e3ce-4655-805e-3542ee84ca5f roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22742025-01-08T15:32:15.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 99a3e4e8-e3ce-4655-805e-3542ee84ca5f resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22752025-01-08T15:32:15.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 99a3e4e8-e3ce-4655-805e-3542ee84ca5f response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22762025-01-08T15:32:16.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e840baf7-33a0-4972-ba21-bf35b3de22d3 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22772025-01-08T15:32:16.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e840baf7-33a0-4972-ba21-bf35b3de22d3 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22782025-01-08T15:32:16.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e840baf7-33a0-4972-ba21-bf35b3de22d3 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22792025-01-08T15:32:16.786ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1484 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = 20aec454-43c2-44b6-8894-a6264df55993 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
22802025-01-08T15:32:17.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 85b2e6e9-ae38-4a6d-bce3-34b5eaaf32a6 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22812025-01-08T15:32:17.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 85b2e6e9-ae38-4a6d-bce3-34b5eaaf32a6 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22822025-01-08T15:32:17.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 85b2e6e9-ae38-4a6d-bce3-34b5eaaf32a6 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22832025-01-08T15:32:18.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 44f081aa-16ac-4572-9870-ac20cc4b87c8 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22842025-01-08T15:32:18.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 44f081aa-16ac-4572-9870-ac20cc4b87c8 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22852025-01-08T15:32:18.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 44f081aa-16ac-4572-9870-ac20cc4b87c8 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
22862025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
22872025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
22882025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22892025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22902025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
22912025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
22922025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
22932025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22942025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
22952025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
22962025-01-08T15:32:18.605ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22972025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22982025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22992025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
23002025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23012025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23022025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
23032025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
23042025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23052025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
23062025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23072025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23082025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
23092025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23102025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23112025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
23122025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23132025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23142025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23152025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23162025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23172025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
23182025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
23192025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
23202025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23212025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23222025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23232025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
23242025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23252025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23262025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23272025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23282025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23292025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23302025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23312025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23322025-01-08T15:32:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23332025-01-08T15:32:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23342025-01-08T15:32:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23352025-01-08T15:32:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23362025-01-08T15:32:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23372025-01-08T15:32:18.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37502, tv_nsec: 737859241 } })
23382025-01-08T15:32:18.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
23392025-01-08T15:32:18.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23402025-01-08T15:32:18.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23412025-01-08T15:32:18.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23422025-01-08T15:32:18.609ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.094899ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23432025-01-08T15:32:18.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23442025-01-08T15:32:18.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23452025-01-08T15:32:18.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23462025-01-08T15:32:18.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23472025-01-08T15:32:18.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23482025-01-08T15:32:18.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23492025-01-08T15:32:18.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23502025-01-08T15:32:18.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23512025-01-08T15:32:18.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23522025-01-08T15:32:18.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23532025-01-08T15:32:18.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23542025-01-08T15:32:18.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23552025-01-08T15:32:18.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23562025-01-08T15:32:18.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23572025-01-08T15:32:18.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23582025-01-08T15:32:18.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23592025-01-08T15:32:18.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23602025-01-08T15:32:18.615ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37502, tv_nsec: 745156466 } })
23612025-01-08T15:32:18.615ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
23622025-01-08T15:32:18.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.896907ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
23632025-01-08T15:32:18.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.564231ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23642025-01-08T15:32:18.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23652025-01-08T15:32:18.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23662025-01-08T15:32:18.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23672025-01-08T15:32:18.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23682025-01-08T15:32:18.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23692025-01-08T15:32:18.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23702025-01-08T15:32:18.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23712025-01-08T15:32:18.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23722025-01-08T15:32:18.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23732025-01-08T15:32:18.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23742025-01-08T15:32:18.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23752025-01-08T15:32:18.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23762025-01-08T15:32:18.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23772025-01-08T15:32:18.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23782025-01-08T15:32:18.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23792025-01-08T15:32:18.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23802025-01-08T15:32:18.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23812025-01-08T15:32:18.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23822025-01-08T15:32:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23832025-01-08T15:32:18.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23842025-01-08T15:32:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23852025-01-08T15:32:18.651ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23862025-01-08T15:32:18.651ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23872025-01-08T15:32:18.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23882025-01-08T15:32:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23892025-01-08T15:32:18.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23902025-01-08T15:32:18.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23912025-01-08T15:32:18.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23922025-01-08T15:32:18.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23932025-01-08T15:32:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23942025-01-08T15:32:18.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23952025-01-08T15:32:18.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23962025-01-08T15:32:18.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23972025-01-08T15:32:18.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23982025-01-08T15:32:18.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.678586ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
23992025-01-08T15:32:18.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24002025-01-08T15:32:18.671ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24012025-01-08T15:32:18.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24022025-01-08T15:32:18.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
24032025-01-08T15:32:18.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24042025-01-08T15:32:18.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24052025-01-08T15:32:18.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24062025-01-08T15:32:18.705ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24072025-01-08T15:32:18.705ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1eb51cf-1a83-4cd7-ac61-8b4a85a619a7", "content-length": "26", "date": "Wed, 08 Jan 2025 15:32:18 GMT"} })
24082025-01-08T15:32:18.705ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24092025-01-08T15:32:18.707ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24102025-01-08T15:32:18.707ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24112025-01-08T15:32:18.707ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5575f49e-8040-4ebc-ae9e-a4b8abfb035e", "content-length": "372", "date": "Wed, 08 Jan 2025 15:32:18 GMT"} })
24122025-01-08T15:32:18.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24132025-01-08T15:32:18.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24142025-01-08T15:32:18.708ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24152025-01-08T15:32:18.710ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ba54f0e2-bde0-4da7-a58e-566dc5903c14.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 37502, tv_nsec: 839608887 } })
24162025-01-08T15:32:18.712ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24172025-01-08T15:32:18.712ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24182025-01-08T15:32:18.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24192025-01-08T15:32:18.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.760568ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24202025-01-08T15:32:18.712ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
24212025-01-08T15:32:18.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24222025-01-08T15:32:18.714ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.29547ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
24232025-01-08T15:32:18.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24242025-01-08T15:32:18.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24252025-01-08T15:32:18.725ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24262025-01-08T15:32:18.725ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24272025-01-08T15:32:18.725ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f20e89d5-bb0a-4a7c-a98e-a6d861699983", "content-length": "26", "date": "Wed, 08 Jan 2025 15:32:18 GMT"} })
24282025-01-08T15:32:18.725ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24292025-01-08T15:32:18.728ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24302025-01-08T15:32:18.730ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
24312025-01-08T15:32:18.730ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 125.422927ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
24322025-01-08T15:32:18.733ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
24332025-01-08T15:32:18.733ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24342025-01-08T15:32:18.733ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7b28181f-71ce-48a9-81e0-39c556939d21", "date": "Wed, 08 Jan 2025 15:32:18 GMT"} })
24352025-01-08T15:32:18.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24362025-01-08T15:32:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24372025-01-08T15:32:18.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24382025-01-08T15:32:18.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24392025-01-08T15:32:18.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24402025-01-08T15:32:18.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24412025-01-08T15:32:18.748ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24422025-01-08T15:32:18.748ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 142.99732ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24432025-01-08T15:32:18.748ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24442025-01-08T15:32:18.751ZINFOnexus (BackgroundTasks): VPC route manager sled ba54f0e2-bde0-4da7-a58e-566dc5903c14 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24452025-01-08T15:32:18.751ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24462025-01-08T15:32:18.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ba54f0e2-bde0-4da7-a58e-566dc5903c14, lookup_type: ById(ba54f0e2-bde0-4da7-a58e-566dc5903c14) } result = Ok(())
24472025-01-08T15:32:18.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24482025-01-08T15:32:18.751ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b3c8fb88-0b2c-4e0b-8213-c3bc1cb41b01", "date": "Wed, 08 Jan 2025 15:32:18 GMT"} })
24492025-01-08T15:32:18.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24502025-01-08T15:32:18.752ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24512025-01-08T15:32:18.752ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24522025-01-08T15:32:18.752ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.365933ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24532025-01-08T15:32:18.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 147.737899ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24542025-01-08T15:32:18.753ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 148.134254ms iteration = 26 status = 0
24552025-01-08T15:32:18.753ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 148.682452ms iteration = 28 status = {}
24562025-01-08T15:32:18.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24572025-01-08T15:32:18.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24582025-01-08T15:32:18.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24592025-01-08T15:32:18.764ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24602025-01-08T15:32:18.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24612025-01-08T15:32:18.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24622025-01-08T15:32:18.772ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.049517ms iteration = 30 status = {"physical_disks_added":0}
24632025-01-08T15:32:18.781ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24642025-01-08T15:32:18.781ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "719200a1-6edb-4883-b6a5-e12de97baf1d", "content-length": "2", "date": "Wed, 08 Jan 2025 15:32:18 GMT"} })
24652025-01-08T15:32:18.783ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24662025-01-08T15:32:18.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24672025-01-08T15:32:18.785ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 180.274178ms iteration = 26 status = null
24682025-01-08T15:32:18.795ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 zone_address = fd00:1122:3344:101::2
24692025-01-08T15:32:18.795ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24702025-01-08T15:32:18.795ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "923fd3b2-5833-4a77-a898-e5e03310251a", "content-length": "26", "date": "Wed, 08 Jan 2025 15:32:18 GMT"} })
24712025-01-08T15:32:18.795ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24722025-01-08T15:32:18.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24732025-01-08T15:32:18.797ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
24742025-01-08T15:32:18.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24752025-01-08T15:32:18.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24762025-01-08T15:32:18.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24772025-01-08T15:32:18.800ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 195.252623ms iteration = 26 status = {}
24782025-01-08T15:32:18.993ZDEBGnexus (BackgroundTasks): client request SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24792025-01-08T15:32:18.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24802025-01-08T15:32:18.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24812025-01-08T15:32:18.996ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c89e6001-fd6e-44a5-b55c-f8de6aa423f5, rack_id: fa7d62e1-57d8-49cc-9dd2-a5f8873ea528, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dc3d148e-05d3-48a7-97ee-42577ccf7e15) } rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0
24822025-01-08T15:32:18.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24832025-01-08T15:32:18.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24842025-01-08T15:32:19.005ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24852025-01-08T15:32:19.005ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "80719162-f1e9-4cfc-ab99-6aa6380a063c", "content-length": "134", "date": "Wed, 08 Jan 2025 15:32:18 GMT"} })
24862025-01-08T15:32:19.005ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24872025-01-08T15:32:19.005ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dc3d148e-05d3-48a7-97ee-42577ccf7e15
24882025-01-08T15:32:19.006ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24892025-01-08T15:32:19.006ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24902025-01-08T15:32:19.006ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24912025-01-08T15:32:19.006ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24922025-01-08T15:32:19.006ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24932025-01-08T15:32:19.006ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24942025-01-08T15:32:19.006ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24952025-01-08T15:32:19.006ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24962025-01-08T15:32:19.006ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528
24972025-01-08T15:32:19.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24982025-01-08T15:32:19.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24992025-01-08T15:32:19.009ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25002025-01-08T15:32:19.009ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4484b06-94a4-43fa-be34-f218d00f8a60", "content-length": "2", "date": "Wed, 08 Jan 2025 15:32:18 GMT"} })
25012025-01-08T15:32:19.009ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25022025-01-08T15:32:19.009ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "95d92077-0f82-4a3a-99a4-513fe521b7e7", "content-length": "51", "date": "Wed, 08 Jan 2025 15:32:18 GMT"} })
25032025-01-08T15:32:19.009ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch_location = Switch0
25042025-01-08T15:32:19.009ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25052025-01-08T15:32:19.040ZDEBGnexus (BackgroundTasks): client response SledAgent = ba54f0e2-bde0-4da7-a58e-566dc5903c14 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc69f2ad-d5db-45e8-84df-d7030f0dfbd2", "content-length": "691", "date": "Wed, 08 Jan 2025 15:32:19 GMT"} })
25062025-01-08T15:32:19.040ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
25072025-01-08T15:32:19.040ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25082025-01-08T15:32:19.040ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25092025-01-08T15:32:19.046ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 441.698694ms iteration = 27 status = {}
25102025-01-08T15:32:19.143ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "59ce767a-94dd-4aeb-9ae2-2a18ac34f72f", "date": "Wed, 08 Jan 2025 15:32:19 GMT"} })
25112025-01-08T15:32:19.143ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 switch = Switch0
25122025-01-08T15:32:19.143ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25132025-01-08T15:32:19.143ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fa7d62e1-57d8-49cc-9dd2-a5f8873ea528 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "66140836-e60e-41d5-8a7a-47a3f900e023", "content-length": "682", "date": "Wed, 08 Jan 2025 15:32:19 GMT"} })
25142025-01-08T15:32:19.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25152025-01-08T15:32:19.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25162025-01-08T15:32:19.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25172025-01-08T15:32:19.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25182025-01-08T15:32:19.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25192025-01-08T15:32:19.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25202025-01-08T15:32:19.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25212025-01-08T15:32:19.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25222025-01-08T15:32:19.160ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 555.567154ms iteration = 26 status = {}
25232025-01-08T15:32:19.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6a9fe496-1f65-4fc2-a046-4998278af8f5 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25242025-01-08T15:32:19.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6a9fe496-1f65-4fc2-a046-4998278af8f5 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25252025-01-08T15:32:19.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6a9fe496-1f65-4fc2-a046-4998278af8f5 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25262025-01-08T15:32:20.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 76c343cd-b70c-45ce-bfe4-2460fec3da85 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25272025-01-08T15:32:20.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 76c343cd-b70c-45ce-bfe4-2460fec3da85 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25282025-01-08T15:32:20.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 76c343cd-b70c-45ce-bfe4-2460fec3da85 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25292025-01-08T15:32:21.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 53b29ec2-f517-4818-86e5-641cd104c56f roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25302025-01-08T15:32:21.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 53b29ec2-f517-4818-86e5-641cd104c56f resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25312025-01-08T15:32:21.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 53b29ec2-f517-4818-86e5-641cd104c56f response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25322025-01-08T15:32:21.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 3b6df7cd-32a9-4251-824f-ff4c20c0f249 roles = RoleSet { roles: {} } uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?sort_by=id_ascending
25332025-01-08T15:32:21.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 3b6df7cd-32a9-4251-824f-ff4c20c0f249 resource = Database result = Ok(()) uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?sort_by=id_ascending
25342025-01-08T15:32:21.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 3b6df7cd-32a9-4251-824f-ff4c20c0f249 response_code = 200 uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?sort_by=id_ascending
25352025-01-08T15:32:21.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 50429606-6244-4301-9835-4e15ee321ae7 roles = RoleSet { roles: {} } uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDIxMTVkNi04NWEzLTQwNmItYmY4Mi0zMGYzNDFkZGU4YjgifX0%3D
25362025-01-08T15:32:21.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 50429606-6244-4301-9835-4e15ee321ae7 resource = Database result = Ok(()) uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDIxMTVkNi04NWEzLTQwNmItYmY4Mi0zMGYzNDFkZGU4YjgifX0%3D
25372025-01-08T15:32:21.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35100 req_id = 50429606-6244-4301-9835-4e15ee321ae7 response_code = 200 uri = /metrics/collectors/f71f2083-2d2b-4618-9504-0628977ed486/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDIxMTVkNi04NWEzLTQwNmItYmY4Mi0zMGYzNDFkZGU4YjgifX0%3D
25382025-01-08T15:32:22.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c521c4d9-d97f-41f7-b051-0ecffed9e3c5 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25392025-01-08T15:32:22.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c521c4d9-d97f-41f7-b051-0ecffed9e3c5 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25402025-01-08T15:32:22.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c521c4d9-d97f-41f7-b051-0ecffed9e3c5 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25412025-01-08T15:32:22.529ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44432
25422025-01-08T15:32:22.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44432 req_id = 4dbf7123-e9fd-452f-a5e1-d92dd978ec48 roles = RoleSet { roles: {} } uri = /metrics/producers
25432025-01-08T15:32:22.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44432 req_id = 4dbf7123-e9fd-452f-a5e1-d92dd978ec48 resource = Database result = Ok(()) uri = /metrics/producers
25442025-01-08T15:32:22.572ZINFOnexus: assigned collector to new producer collector_id = f71f2083-2d2b-4618-9504-0628977ed486 file = nexus/src/app/oximeter.rs:76 producer_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
25452025-01-08T15:32:22.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42463 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44432 req_id = 4dbf7123-e9fd-452f-a5e1-d92dd978ec48 response_code = 201 uri = /metrics/producers
25462025-01-08T15:32:23.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 35fa9d11-dd67-48de-b6cf-de80e3d94f18 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25472025-01-08T15:32:23.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 35fa9d11-dd67-48de-b6cf-de80e3d94f18 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25482025-01-08T15:32:23.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 35fa9d11-dd67-48de-b6cf-de80e3d94f18 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25492025-01-08T15:32:24.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 5792d621-227c-4b39-b3aa-e4279a7a82a3 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25502025-01-08T15:32:24.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 5792d621-227c-4b39-b3aa-e4279a7a82a3 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25512025-01-08T15:32:24.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 5792d621-227c-4b39-b3aa-e4279a7a82a3 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25522025-01-08T15:32:25.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 47ec02ba-1c26-490f-80b6-0c0c82ebf2a6 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25532025-01-08T15:32:25.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 47ec02ba-1c26-490f-80b6-0c0c82ebf2a6 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25542025-01-08T15:32:25.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 47ec02ba-1c26-490f-80b6-0c0c82ebf2a6 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25552025-01-08T15:32:26.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f7cba1c8-a491-440f-8913-1eef74aefd8c roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25562025-01-08T15:32:26.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f7cba1c8-a491-440f-8913-1eef74aefd8c resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25572025-01-08T15:32:26.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = f7cba1c8-a491-440f-8913-1eef74aefd8c response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25582025-01-08T15:32:26.786ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1376 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = b1fb9510-8516-4a0a-be48-0275c35ee3a2 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
25592025-01-08T15:32:27.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c64fb9fb-74aa-4d08-9a04-1505d578d3bc roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25602025-01-08T15:32:27.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c64fb9fb-74aa-4d08-9a04-1505d578d3bc resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25612025-01-08T15:32:27.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c64fb9fb-74aa-4d08-9a04-1505d578d3bc response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25622025-01-08T15:32:28.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4b67f8a7-5858-40f2-ba26-57c9812f3ac6 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25632025-01-08T15:32:28.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4b67f8a7-5858-40f2-ba26-57c9812f3ac6 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25642025-01-08T15:32:28.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4b67f8a7-5858-40f2-ba26-57c9812f3ac6 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25652025-01-08T15:32:28.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
25662025-01-08T15:32:28.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25672025-01-08T15:32:28.604ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
25682025-01-08T15:32:28.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25692025-01-08T15:32:28.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25702025-01-08T15:32:28.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25712025-01-08T15:32:28.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25722025-01-08T15:32:28.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25732025-01-08T15:32:28.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25742025-01-08T15:32:28.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25752025-01-08T15:32:28.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25762025-01-08T15:32:28.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25772025-01-08T15:32:28.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25782025-01-08T15:32:28.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25792025-01-08T15:32:28.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25802025-01-08T15:32:28.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
25812025-01-08T15:32:28.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25822025-01-08T15:32:28.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25832025-01-08T15:32:28.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
25842025-01-08T15:32:28.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.53223ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
25852025-01-08T15:32:28.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.582137ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25862025-01-08T15:32:29.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1c02ee6d-cba1-4e16-aa0e-0d63f7c39f6c roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25872025-01-08T15:32:29.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1c02ee6d-cba1-4e16-aa0e-0d63f7c39f6c resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25882025-01-08T15:32:29.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1c02ee6d-cba1-4e16-aa0e-0d63f7c39f6c response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25892025-01-08T15:32:30.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6bd43120-6fbd-45f3-8344-df357ce6e83d roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25902025-01-08T15:32:30.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6bd43120-6fbd-45f3-8344-df357ce6e83d resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25912025-01-08T15:32:30.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 6bd43120-6fbd-45f3-8344-df357ce6e83d response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25922025-01-08T15:32:31.328ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61159
25932025-01-08T15:32:31.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61159 req_id = 54e50569-53bc-4f6f-bd17-0f2967e171d3 roles = RoleSet { roles: {} } uri = /metrics/producers
25942025-01-08T15:32:31.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61159 req_id = 54e50569-53bc-4f6f-bd17-0f2967e171d3 resource = Database result = Ok(()) uri = /metrics/producers
25952025-01-08T15:32:31.340ZINFOnexus: assigned collector to new producer collector_id = f71f2083-2d2b-4618-9504-0628977ed486 file = nexus/src/app/oximeter.rs:76 producer_id = cdcf4cda-2d73-426f-a1b1-320128442a2c
25962025-01-08T15:32:31.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12049 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61159 req_id = 54e50569-53bc-4f6f-bd17-0f2967e171d3 response_code = 201 uri = /metrics/producers
25972025-01-08T15:32:31.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 233011a5-2d1f-45a7-b105-235595342088 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25982025-01-08T15:32:31.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 233011a5-2d1f-45a7-b105-235595342088 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
25992025-01-08T15:32:31.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 233011a5-2d1f-45a7-b105-235595342088 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26002025-01-08T15:32:32.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 9c5a1b27-7a4a-4456-89c4-20c81f08c3ab roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26012025-01-08T15:32:32.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 9c5a1b27-7a4a-4456-89c4-20c81f08c3ab resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26022025-01-08T15:32:32.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 9c5a1b27-7a4a-4456-89c4-20c81f08c3ab response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26032025-01-08T15:32:32.612ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50758
26042025-01-08T15:32:32.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50758 req_id = 9ad303fc-6d7d-4fbd-b03b-60c3f95804d4 roles = RoleSet { roles: {} } uri = /metrics/producers
26052025-01-08T15:32:32.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50758 req_id = 9ad303fc-6d7d-4fbd-b03b-60c3f95804d4 resource = Database result = Ok(()) uri = /metrics/producers
26062025-01-08T15:32:32.649ZINFOnexus: assigned collector to new producer collector_id = f71f2083-2d2b-4618-9504-0628977ed486 file = nexus/src/app/oximeter.rs:76 producer_id = 89e58b24-69fa-48cb-89a7-c60fedd5f16e
26072025-01-08T15:32:32.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36894 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50758 req_id = 9ad303fc-6d7d-4fbd-b03b-60c3f95804d4 response_code = 201 uri = /metrics/producers
26082025-01-08T15:32:33.002ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52574
26092025-01-08T15:32:33.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52574 req_id = db9d38ed-611d-4767-9637-7c4d52908dde roles = RoleSet { roles: {} } uri = /metrics/producers
26102025-01-08T15:32:33.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52574 req_id = db9d38ed-611d-4767-9637-7c4d52908dde resource = Database result = Ok(()) uri = /metrics/producers
26112025-01-08T15:32:33.047ZINFOnexus: assigned collector to new producer collector_id = f71f2083-2d2b-4618-9504-0628977ed486 file = nexus/src/app/oximeter.rs:76 producer_id = fd2115d6-85a3-406b-bf82-30f341dde8b8
26122025-01-08T15:32:33.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45014 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52574 req_id = db9d38ed-611d-4767-9637-7c4d52908dde response_code = 201 uri = /metrics/producers
26132025-01-08T15:32:33.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 39b1eb35-3261-435c-8302-51a58507b1f0 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26142025-01-08T15:32:33.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 39b1eb35-3261-435c-8302-51a58507b1f0 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26152025-01-08T15:32:33.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 39b1eb35-3261-435c-8302-51a58507b1f0 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26162025-01-08T15:32:34.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 853b2a60-35d0-49c5-a45f-34e8c67d2070 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26172025-01-08T15:32:34.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 853b2a60-35d0-49c5-a45f-34e8c67d2070 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26182025-01-08T15:32:34.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 853b2a60-35d0-49c5-a45f-34e8c67d2070 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26192025-01-08T15:32:34.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 87b25941-d47b-4b8c-8f29-c90784727891 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
26202025-01-08T15:32:34.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 87b25941-d47b-4b8c-8f29-c90784727891 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
26212025-01-08T15:32:34.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59658 req_id = 87b25941-d47b-4b8c-8f29-c90784727891 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
26222025-01-08T15:32:35.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1e8669fb-f461-4495-b0de-604a59a5742d roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26232025-01-08T15:32:35.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1e8669fb-f461-4495-b0de-604a59a5742d resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26242025-01-08T15:32:35.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 1e8669fb-f461-4495-b0de-604a59a5742d response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26252025-01-08T15:32:36.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c38f1fd7-45e1-4224-b430-dfa9ea02d86b roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26262025-01-08T15:32:36.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c38f1fd7-45e1-4224-b430-dfa9ea02d86b resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26272025-01-08T15:32:36.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = c38f1fd7-45e1-4224-b430-dfa9ea02d86b response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26282025-01-08T15:32:36.785ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1412 local_addr = [fd00:1122:3344:101::b]:42832 method = GET remote_addr = [fd00:1122:3344:101::d]:38878 req_id = ee474664-ce0f-4a26-8cf1-1652300588d8 response_code = 200 uri = /4cece465-e930-47ca-aa88-ed170e15d28a
26292025-01-08T15:32:37.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 9b2ebb27-f332-40a8-a9ad-d7c969703747 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26302025-01-08T15:32:37.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 9b2ebb27-f332-40a8-a9ad-d7c969703747 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26312025-01-08T15:32:37.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 9b2ebb27-f332-40a8-a9ad-d7c969703747 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26322025-01-08T15:32:38.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
26332025-01-08T15:32:38.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
26342025-01-08T15:32:38.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26352025-01-08T15:32:38.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26362025-01-08T15:32:38.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26372025-01-08T15:32:38.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26382025-01-08T15:32:38.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26392025-01-08T15:32:38.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26402025-01-08T15:32:38.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26412025-01-08T15:32:38.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.15083ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26422025-01-08T15:32:38.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26432025-01-08T15:32:38.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26442025-01-08T15:32:38.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26452025-01-08T15:32:38.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26462025-01-08T15:32:38.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26472025-01-08T15:32:38.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26482025-01-08T15:32:38.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1b4c659d-f43a-4365-bdbe-8f16cc83f04f, lookup_type: ById(1b4c659d-f43a-4365-bdbe-8f16cc83f04f) } result = Ok(())
26492025-01-08T15:32:38.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26502025-01-08T15:32:38.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26512025-01-08T15:32:38.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f original_time_created = 2025-01-08 15:19:38.123187 UTC target_id = 1b4c659d-f43a-4365-bdbe-8f16cc83f04f time_created = 2025-01-08 15:19:38.123187 UTC
26522025-01-08T15:32:38.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.926166ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1b4c659d-f43a-4365-bdbe-8f16cc83f04f","time_created":"2025-01-08T15:19:38.123187Z"}
26532025-01-08T15:32:38.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2642bfc1-1833-4f16-a576-78c1f8492bef roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26542025-01-08T15:32:38.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2642bfc1-1833-4f16-a576-78c1f8492bef resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26552025-01-08T15:32:38.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 2642bfc1-1833-4f16-a576-78c1f8492bef response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26562025-01-08T15:32:39.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e8bb78c8-4da4-4341-8d73-5e35a0d827f8 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26572025-01-08T15:32:39.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e8bb78c8-4da4-4341-8d73-5e35a0d827f8 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26582025-01-08T15:32:39.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = e8bb78c8-4da4-4341-8d73-5e35a0d827f8 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26592025-01-08T15:32:40.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = ee9d08d3-a536-4be7-b7fa-5a4e38dc2982 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26602025-01-08T15:32:40.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = ee9d08d3-a536-4be7-b7fa-5a4e38dc2982 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26612025-01-08T15:32:40.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = ee9d08d3-a536-4be7-b7fa-5a4e38dc2982 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26622025-01-08T15:32:41.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 92ab86d8-f249-4468-a148-23dff0d444d0 roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26632025-01-08T15:32:41.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 92ab86d8-f249-4468-a148-23dff0d444d0 resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26642025-01-08T15:32:41.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 92ab86d8-f249-4468-a148-23dff0d444d0 response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26652025-01-08T15:32:42.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4d02b243-4394-474b-994c-3bb2b8da145e roles = RoleSet { roles: {} } uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26662025-01-08T15:32:42.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4d02b243-4394-474b-994c-3bb2b8da145e resource = Database result = Ok(()) uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14
26672025-01-08T15:32:42.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63956 req_id = 4d02b243-4394-474b-994c-3bb2b8da145e response_code = 200 uri = /probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14